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Foreword 


This  volume  is  a  background  paper  for  OTA's  assessment,  The  Implications  of 
Cost-Effectiveness  Analysis  of  Medical  Technology.  That  assessment  analyzes  the 
feasibility,  implications,  and  usefulness  of  applying  cost-effectiveness  and  cost-benefit 
analysis  (CEA/CBA)  in  health  care  decisionmaking.  The  major,  policy-oriented  report 
of  the  assessment  was  published  in  August  1980.  In  addition  to  the  main  report,  there 
will  be  five  background  papers:  1)  the  present  document  which  addresses  methodolog- 
ical issues  and  reviews  the  CEA/CBA  literature,  2)  a  psychotherapy  case  study,  3)  a 
diagnostic  X-ray  case  study,  4)  17  other  case  studies  of  individual  medical  technol- 
ogies, and  5)  a  review  of  international  experience  in  managing  medical  technology. 
Another  related  report  was  published  in  September  of  1979:  A  Review  of  Selected  Fed- 
eral Vaccine  and  Immunization  Policies. 

Background  Paper  #1:  Methodological  Issues  and  Literature  Review,  parts  of 
which  are  based  substantially  on  work  done  for  OTA  by  Dr.  Kenneth  Warner  of  the 
University  of  Michigan,  was  prepared  by  OTA  staff.  In  preparing  this  paper,  OTA 
consulted  with  members  of  the  advisory  panel  to  the  overall  assessment;  with  the  au- 
thors of  the  case  studies  prepared  for  the  assessment;  and  with  numerous  other  experts 
in  economics,  medicine,  ethics,  and  health  policy. 

Drafts  of  this  paper  were  reviewed  by  the  advisory  panel  chaired  by  Dr.  John  Hog- 
ness,  by  the  Health  Program  Advisory  Committee  chaired  by  Dr.  Frederick  Robbins, 
and  by  approximately  75  other  individuals  and  groups  representing  a  wide  range  of 
disciplines  and  perspectives.  We  are  grateful  for  their  assistance. 
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Introduction  and  Background 


With  the  desires  to  control  costs,  enhance 
quality,  and  improve  access  to  health  care  has 
come  the  need  to  identify,  and  to  understand 
what  is  meant  by,  cost-effective  medical  care. 
Two  closely  related  evaluative  techniques — 
cost-effectiveness  analysis  and  cost-benefit  anal- 
ysis (CEA  and  CBA,  respectively) — are  being 
used  or  advocated  with  increasing  frequency  to 
address  this  need.  As  measured  by  contributions 
to  the  literature,  professional  interest  in  these 
techniques  and  in  their  findings  grew  exponen- 
tially through  the  past  decade.  A  reading  of  this 
literature,  combined  with  discussions  with  nu- 
merous individuals  and  groups,  indicates  con- 
siderable excitement,  widespread  confusion, 
and  a  growing  caution  about  the  methods,  im- 
plications, and  usefulness  of  CEA  and  CBA  in 
health  care. 

As  a  result  of  these  cost-related  concerns  and 
the  growth  of  interest  in  CEA  and  CBA,  OTA 
was  asked  by  the  Senate  Committees  on  Labor 
and  Human  Resources  and  on  Finance  to  exam- 
ine the  feasibility,  usefulness,  and  implications 
of  using  cost-effectiveness  information  in  deci- 
sions relating  to  medical  technologies.  The  re- 


sulting assessment,  which  includes  this  back- 
ground paper  on  methodology,  examines  cost 
effectiveness  by  asking  three  major  questions: 

•  What  is  the  technical,  or  methodological, 
validity  of  CEA  and  CBA  when  used  to  as- 
sess certain  types  of  medical  technologies 
within  certain  settings? 

•  What  are  the  implications  of  using  CEA  or 
CBA?  That  is,  what  are  the  value  and  ethi- 
cal, legal,  political,  medical,  health,  and 
economic  implications? 

•  Can  CEA  and  CBA  be  used  appropriately 
in  health  care  areas  such  as  reimbursement, 
health  planning,  individual  physician  deci- 
sionmaking, or  prepaid  group  practice? 

The  present  background  paper  focuses  on  as- 
pects of  the  first  question.  All  three  questions 
are  examined  in  the  main  report  of  the  assess- 
ment. (That  main  report  and  the  four  other 
background  papers  are  described  briefly  in  app. 
D.)  This  volume  critically  examines  the  methods 
of  cost-benefit  and  cost-effectiveness  analysis 
and  reviews  the  literature  on  CEA  and  CBA  in 
health  care. 


DEFINITIONS  OF  CEA  AND  CBA 

The  terms  cost-effectiveness  and  cost-benefit 
analysis  refer  to  formal  analytical  techniques  for 
comparing  the  negative  and  positive  conse- 
quences of  alternative  projects.  Each  of  us  en- 
gages in  CEA/CBA-like  thinking  every  day,  fre- 
quently subconsciously.  'And  ultimately,  some- 
thing like  (CEA/CBA)  must  necessarily  be  em- 
ployed in  any  rational  decision"  (729). 

In  this  report,  the  term  CEA/CBA  is  used  to 
refer  to  the  class  of  techniques  that  includes  both 
CEA  and  CBA.  In  practice,  the  comparison  of 
costs  and  benefits  is  accomplished  through  a 
spectrum  of  approaches,  ranging  from  sophisti- 
cated computer-based  mathematical  program- 
ing using  large  amounts  of  epidemiological  and 


other  data  to  partially  intuitive,  best-guess  esti- 
mates of  costs  and  benefits.  Some  analyses  may 
take  into  account  the  results  of  clinical  trials  of  a 
technology  and  model  the  technology's  effect  on 
health  outcomes.  Others  may  assume  that  the 
alternative  technologies  under  study  have  equal 
effectiveness  and  concentrate  on  the  difference 
in  costs  involved. 

Thus,  there  is  a  continuum  of  analyses  that 
examine  costs  and  benefits.  One  end  of  the  con- 
tinuum comprises  what  will  be  referred  to  as 
"net  cost"  studies.  In  net  cost  studies  the  em- 
phasis is  on  costs,  and  such  studies  in  the  past 
have  often  assumed  benefits  or  efficacy  to  be 
equal.  At  the  other  end  of  the  continuum  are 
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analyses  that  attempt  to  relate  the  use  of  tech- 
nologies under  study  to  specific  health-related 
outcomes  and  to  compare  the  costs  of  the  tech- 
nologies to  the  differential  health  benefits. 
Thus,  CEA/CBA  includes  a  set  of  analytical 
techniques,  differentiated  by  the  specific  costs 
and  benefits  that  are  considered  and  the  manner 
in  which  they  are  analyzed. 

Both  CEA  and  CBA  require  analysts  to  iden- 
tify, measure,  and  compare  all  of  the  relevant 
costs  and  consequences  of  alternative  means  of 
addressing  a  given  problem.  The  objective  of 
CEA/CBA  is  to  structure  and  analyze  informa- 
tion in  a  manner  that  will  inform  and  thereby 
assist  policymakers.  It  is  these  individuals,  and 
not  analysts,  who  will  decide  which,  if  any,  of 
the  competing  program  or  technological  alter- 
natives will  be  proposed  or  implemented. 

The  principal  technical  distinction  between 
CEA  and  CBA  lies  in  the  valuation  of  the  desir- 
able consequences  of  programs.  In  CBA,  all 
such  consequences — benefits — are  valued,  like 
costs,  in  numerical  terms,  almost  always  dol- 
lars. Conceptually,  therefore,  CBA  permits  an 
assessment  of  the  inherent  worth  of  a  program 
— Do  the  benefits  exceed  the  costs? — as  well  as 
comparison  of  competing  program  alternatives 
— Which  of  several  programs  generates  the 
largest  excess  of  benefits  over  costs?  With  all 
costs  and  benefits  measured  in  the  same  (mone- 
tary) unit,  CBA  is  designed  to  allow  compari- 
sons of  similar  or  of  widely  divergent  types  of 
programs.  Thus,  in  theory  at  least,  CBA  might 
be  used  to  decide  whether  certain  public  re- 
sources should  be  allocated  to  construction  of  a 
dam  or  to  construction  of  a  hospital. 

In  CEA,  certain  basic  desirable  consequences 
are  not  valued  in  monetary  terms,  but  rather  are 
measured  in  some  other  unit.  In  health  care 
CEAs,  common  measures  include  years  of  life 
saved  and  days  of  morbidity  or  disability 
avoided.  The  reason  for  a  nonmonetary  meas- 
ure of  program  effectiveness  is  either  the  im- 
possibility or  undesirability  of  valuing  impor- 
tant outcomes  in  dollars  and  cents.  Unlike  the 
bottom  line  of  a  CBA,  a  CEA  is  not  a  net  mone- 
tary value;  rather,  it  is  expressed  in  units  such  as 
"dollars  per  year  of  life  saved."  CEA  permits 
comparison  of  cost  per  unit  of  effectiveness 


among  competing  program  alternatives  de- 
signed to  serve  the  same  basic  purpose.  Unlike 
CBA,  however,  the  technique  does  not  allow 
comparison  of  programs  having  widely  dif- 
ferent objectives — because  the  effectiveness  or 
outcome  measures  differ — nor  does  it  permit 
assessment  of  the  inherent  worth  of  a  program. 
Is  a  cost  of  $50,000  per  year  of  life  saved  accept- 
able? Obviously,  this  last  question  requires  a 
social  and  political  judgment;  it  is  not  a  techni- 
cal matter. 

Choice  of  CEA  or  CBA  will  depend  on  techni- 
cal considerations,  the  predisposition  of  ana- 
lysts and  their  clients,  and  on  the  type  of  ques- 
tion being  addressed.  Neither  technique  is  neces- 
sarily superior  to  the  other.  CBA  may  be  the 
theoretical  ideal,  since  it  permits  direct  compari- 
son of  the  desirable  and  undesirable  conse- 
quences of  diverse  programs,  but  problems  of 
benefit  valuation  are  myriad,  particularly  in 
social  welfare  areas  such  as  health  care.  CEA 
avoids  the  methodologically  difficult  and  mor- 
ally ambiguous  task  of  assigning  monetary  val- 
ues to  such  nonmonetary  measures  as  years  of 
human  life.  By  rejecting  the  monetary  measure 
of  CBA,  however,  the  CEA  analyst  loses  a  uni- 
fying metric  with  which  to  weigh  and  compare 
different  types  of  effectiveness.  How  are  two 
programs  to  be  compared  when  one  program 
averts  many  deaths  but  has  limited  effect  on  dis- 
ability, and  the  other  prevents  considerable  dis- 
ability but  averts  only  a  few  deaths?  Methodo- 
logical advances  (such  as  measures  of  quality- 
adjusted  life  years)  may  in  time  ameliorate  this 
inadequacy,  but  considerable  barriers  to  using 
CEA  to  evaluate  programs  with  significantly 
different  effects  still  remain. 

Both  CEA  and  CBA  can  be  used  for  purposes 
of  planning  for  the  future  or  evaluating  past 
program  performance.  As  planning  tools,  the 
techniques  involve  prospective  analysis,  i.e.,  an 
attempt  to  predict  the  costs  and  benefits  (or  ef- 
fectiveness) of  alternative  future  programs. 
Analysis  may  draw  on  past  or  existing  programs 
for  data  and  ideas  as  to  how  to  model  the  struc- 
ture of  the  future  programs,  but  the  focus  re- 
mains distinctly  prospective.  In  addition,  as 
evaluation  tools,  CEA  and  CBA  involve  retro- 
spective assessment  of  the  realized  costs  and 
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benefits  (or  effectiveness)  of  existing  or  past  pro- 
grams. Frequently,  a  retrospective  evaluation 
will  have  a  prospective  or  planning  intent:  The 
question  is  asked,  should  a  program  be  con- 
tinued into  the  future  and,  if  so,  how  should  it 
be  modified? 

Finally,  in  this  brief  introduction  to  CEA/ 
CBA,  it  is  useful  to  distinguish  these  techniques 
from  others  that  are  frequently  confused  with 
them.  The  two  "sides"  of  a  CEA  or  CBA — as- 
sessment of  a  program's  costs  and  desirable 
consequences — are  important  forms  of  analysis 
in  their  own  right.  The  latter — assessment  of 
effectiveness — is  traditionally  the  focal  point  of 
evaluation  in  health  care.  A  wide  variety  of 
evaluative  approaches,  including  randomized 
clinical  trials  and  epidemiological  studies,  form 
the  basis  of  assessment  of  the  efficacy  or  effec- 
tiveness of  numerous  medical  and  public  health 
practices  (405).  Similarly,  though  less  common- 


ly, the  costs  of  certain  programs  or  technologies 
are  assessed  in  a  cost  analysis  which  treats  effec- 
tiveness only  implicitly  or  tangentially.  Finally, 
risk-benefit  analyses  compare  the  desirable  out- 
comes of  a  practice  with  the  undesirable  but 
noneconomic  ones.  Thus,  in  risk-benefit  analy- 
sis, the  ability  of  a  surgical  procedure  to  allevi- 
ate pain  or  prolong  life  might  be  compared  with 
its  operative  mortality  and  postoperative  mor- 
bidity. Ideally,  CEA/CBA  represents  a  merging 
of  all  of  the  concerns  addressed  by  these  evalua- 
tive techniques.  Further,  the  validity  of  any 
CEA  or  CBA  is  directly  dependent  on  the  validi- 
ty of  the  efficacy  information  on  which  it  is 
based. 

The  relative  advantages  and  disadvantages  of 
CEA  and  CBA,  as  well  as  the  technical  problems 
of  both  and  the  implications  of  their  differences, 
are  examined  in  detail  later  in  this  report. 


HISTORY  OF  CEA/CBA 

The  common-sense  principles  of  CEA/CBA 
have  been  promoted  for  centuries.  Formal  ap- 
plication of  CEA/CBA,  however,  is  a  phenom- 
enon of  the  present  century.  In  1902,  the  River 
and  Harbor  Act  directed  the  Corps  of  Engineers 
to  assess  the  costs  and  benefits  of  river  and  har- 
bor projects.  In  1936,  the  Federal  Flood  Control 
Act  required  that  "the  benefits  (of  projects)  to 
whomsoever  they  may  accrue  must  be  in  excess 
of  the  estimated  costs,"  though  the  Act  provided 
no  guidance  as  to  how  benefits  and  costs  were  to 
be  defined  and  measured.  In  the  same  decade, 
both  the  Tennessee  Valley  Authority  and  the 
Department  of  Agriculture  implemented  pro- 
gram budgeting  systems  which  included  rudi- 
mentary attempts  at  formal  CEA/CBA.  Official 
Government  criteria  for  appraisal  of  river  devel- 
opment projects  were  first  enunciated  by  the  Bu- 
reau of  the  Budget  in  1952  (753). 

Early  in  the  Kennedy  administration,  the  De- 
fense Department,  under  Secretary  McNamara, 
adopted  a  program  budgeting  system  which  em- 
ployed CEA/CBA  to  evaluate  alternative  de- 
fense projects.  Success  in  these  endeavors,  com- 


bined with  a  burgeoning  Federal  budget,  led 
President  Johnson  in  1965  to  require  the  im- 
plementation of  planning-programing-budget- 
ing  (PPB)  systems  throughout  the  Federal  bu- 
reaucracy. CEA/CBA  represented  both  the 
spirit  and  the  letter  of  the  new  initiative  to  ra- 
tionalize Government  resource  allocation  deci- 
sionmaking (475). 

PPB  met  with  mixed  and  limited  success,  re- 
flecting a  lack  of  resources  to  implement  it  effec- 
tively, political  and  bureaucratic  opposition  to 
it,  and  unrealistic  expectations  of  its  role  and 
potential  (729).  The  formal  system  did  not  sur- 
vive for  long,  though  many  Washington  observ- 
ers believe  it  left  a  legacy  of  continuing  im- 
provement in  the  use  of  rational  analysis  in 
Government  decisionmaking  (748).  And  recent- 
ly, the  philosophy  and  logic  of  CEA/CBA  and 
PPB  have  been  reincarnated  in  the  form  of  zero 
based  budgeting. 

As  formal  evaluative  techniques,  CEA/CBA 
assess  public  sector  resource  allocation  decisions 
where  conventional  private  sector  techniques, 
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such  as  capital  budgeting  and  return-on-invest- 
ment  analysis,  will  not  suffice.  Commonly,  the 
inadequacy  of  conventional  private  sector  tech- 
niques reflects  the  absence  of  a  smoothly  func- 
tioning market  to  allocate  resources  as  desired, 
resulting  from  either  technical1  problems  or  dis- 
tributional considerations.  The  former  moti- 
vated the  early  applications  of  CEA/CBA.  An 
example  is  the  provision  of  national  defense, 
which  does  not  occur  in  the  private  sector  be- 
cause national  defense  is  what  is  known  as  a 
pure  public  good,  defined  as  a  good  which, 
when  provided  for  one  individual,  benefits  all 
individuals,  since  no  one  can  be  excluded  from 
receiving  the  benefits  and  since  one  person's 
consumption  of  benefits  does  not  reduce  their 
availability  for  other  people.  It  is  impossible  to 
"sell"  national  defense  in  a  private  marketplace, 
because  consumers  are  aware  that  they  will  re- 
ceive it  free  if  it  is  provided  for  anyone  else,  and 
if  they  were  to  buy  it  themselves,  they  would  be 
providing  it  free  to  everyone  else.  Therefore,  na- 
tional defense  will  exist  only  if  it  is  supplied  by 
the  public  sector. 

'Other  sources  of  technical  market  failure  are  closely  related  to 
the  "pure  public  good"  problem.  These  include  significant  econo- 
mies of  scale — i.e.,  decreasing  average  costs  as  the  size  of  a  project 
increases  (e.g.,  a  dam) — and  externalities — loosely,  costs  or  bene- 
fits experienced  by  other  than  the  immediate  decisionmaker  (e.g., 
pollution  of  a  downstream  community's  water  supply  by  a  firm 
dumping  waste  material  upstream).  This  report  will  not  elaborate 
on  these  sources  of  market  failure,  but  merely  emphasize  that  they 
require  nonmarket  decisionmaking  and  hence  provide  candidates 
for  CEA/CBA  (753). 


It  is  no  accident  that  the  origins  of  CEA/CBA 
lie  in  the  area  of  water  resource  management 
and  that  the  Department  of  Defense  was  PPB's 
showcase  in  the  1960's.  Dams,  irrigation  proj- 
ects, and  the  like  have  significant  characteristics 
of  public  goods,  yet  market  analogs  permit  the 
valuation  of  most  of  the  projects'  most  signifi- 
cant costs  and  benefits.  For  example,  a  dam  may 
produce  electricity,  which  has  a  direct  market 
value,  and  provide  flood  control  and  irrigation, 
where  property  values,  insurance  policies,  and 
crop  prices  and  yields  serve  to  value  benefits  or 
costs.  In  the  case  of  defense,  once  an  objective 
has  been  agreed  upon,  evaluation  of  alternative 
projects  may  lend  itself  to  CEA,  a  technique 
used  to  compare  programs  oriented  toward  at- 
tainment of  the  same  quantified,  but  not  mone- 
tarily valued,  outcomes. 

In  the  Federal  PPB  area,  CEA/CBA  has 
achieved  less  consistent  success  in  social  welfare 
areas,  including  education  and  health  programs 
(751),  than  in  the  areas  of  water  resource  man- 
agement and  defense.  The  problems  in  applying 
these  analytical  techniques  in  social  welfare 
areas  include  frequent  disagreement  on  appro- 
priate outcome  measures  and  the  valuing  of  re- 
distributions of  money,  educational  resources, 
access  to  health  care,  and  so  on.  The  benefits  of 
redistribution — the  seeking  of  a  more  just  and 
humane  sharing  of  society's  resources — are  par- 
ticularly difficult  to  quantify  and  value. 


HEALTH  CARE  AND  CEA/CBA 

In  the  period  of  a  decade,  society's  principal 
health  system  goal  has  shifted  from  increasing 
access  to  health  care  to  controlling  the  rapidly 
inflating  costs  of  care.  The  dilemma  today  is  in 
containing  costs  without  sacrificing  desired  ben- 
efits such  as  improved  access  to  health  care  and 
quality.  Thus,  a  logical  approach  would  seem  to 
be  to  identify  and  reduce  the  use  of  tests,  pro- 
cedures, and  visits  which  are  medically  ineffec- 
tive, unnecessary,  or  excessively  expensive  rela- 
tive to  their  limited  effectiveness.  Increasing 
numbers  of  procedures  and  medical  devices  are 
being  cited  as  candidates  for  attention  as  skepti- 


cism about  the  value  of  much  medical  technol- 
ogy replaces  the  enthusiasm  of  former  years.  In- 
terest in  and  encouragement  of  the  analysis  of 
the  safety  and  efficacy  and,  more  recently,  cost 
effectiveness  of  technology  has  accompanied  the 
growing  concern  with  health  cost  inflation 
(405). 

Public  efforts  to  improve  financial  access  to 
care— primarily  through  medicare  and  medic- 
aid— account  for  the  rapid  growth  in  Govern- 
ment's share  of  the  national  health  care  bill. 
Combined  with  increasing  depth  and  breadth  of 
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private  insurance  coverage,  social  programs 
have  reduced  the  linkage  between  receipt  of 
health  care  services  and  financial  liability  for 
them.  Third-party  payment  is  particularly  ex- 
tensive in  the  highest  cost  component  of  the 
health  care  system — hospital  care,  where  Gov- 
ernment and  private  insurance  pay  over  90  per- 
cent of  the  total  bill  (720). 

The  consequence  of  the  growth  in  third-party 
liability  is  that  most  medical  resource  consump- 
tion decisions  are  divorced  from  liability  for 
their  financial  implications.  Thus,  a  physician 
may  order  an  additional  lab  test  which  has  a 
very  low  probability  of  improving  a  diagnosis, 
but  which  will  not  impose  any  direct  and  imme- 
diate additional  financial  burden  on  the  insured 
patient.2  Russell  has  observed  that  ".  .  .  as 
third-party  payment  has  increased  over  the 
years,  the  benefit  required  to  justify  a  decision 
in  the  eyes  of  doctors  and  patients  has  declined. 
This  has  led  to  increased  use  of  resources  in 


2  A  typical  failure  to  comprehend  fully  the  role  and  implications 
of  third-party  reimbursement  is  represented  in  the  propensity  of 
some  critics  to  blame  physicians  for  overuse  of  certain  procedures. 
The  assumption  that  physicians  should  perform  the  appropriate 
social  cost-benefit  calculation  perhaps  puts  them  in  an  untenable 
position:  To  represent  society's  interests,  they  may  be  asked  to 
deny  a  patient  a  procedure  which  might  benefit  the  patient  and  in 
any  case  would  not  harm  the  patient  economically.  This  can  be 
regarded  as  violating  the  medical  ethic  of  representing  the  patient's 
best  interest.  Were  the  patient  responsible  for  paying  the  cost  of 
the  procedure,  then  the  physician's  cost-benefit  calculation  might 
weigh  the  patient's  economic  sacrifice  against  the  potential  for 
medical  benefit. 


many  ways — including  the  introduction  of  tech- 
nologies that  otherwise  might  not  have  been 
adopted  at  all  and,  more  often,  the  more  rapid 
and  extensive  diffusion  of  technologies  that  had 
already  been  adopted  to  some  extent."3  In  some 
respects,  the  principal  constraint  on  the  provi- 
sion of  care  is  the  state  of  the  art  and  the  avail- 
ability of  technology. 

Thus,  a  number  of  factors  have  come  together 
to  create  a  perceived  need  for  formal  evaluation 
on  the  economic  and  medical  implications  of  in- 
dividual technologies:  The  market's  ability  to 
evaluate  and  ration  has  deteriorated  to  the  point 
where  it  plays  a  minor  role  at  best;  as  a  Nation, 
we  want  to  assure  equitable  access  to  needed 
medical  care  and  to  minimize  care  which  is  in- 
effective, unnecessary,  harmful,  or  excessively 
costly;  we  want  to  contain  health  care  costs 
which  currently  impose  significant  burdens  on 
many  citizens  and  whose  continuing  real  growth 
threatens  everyone;  and  we  confront  an  array  of 
new  and  future  medical  technologies  that  may 
be  introduced  into  the  practice  of  medicine  with 
little  regard  for  their  cost  implications  (705).  In 
this  environment,  attention  has  turned  to  non- 
market  means  of  assessing  and  controlling  med- 
ical resource  allocation.  CEA  and  CBA  have 
been  attracting  interest  as  possible  techniques 
for  performing  the  assessment  function. 


'See  L.  Russell,  Technology  in  Hospitals:  Medical  Advances  and 
Their  Diffusion  (Washington,  D.C.:  Brookings  Institution,  1979). 


GROWTH  AND  COMPOSITION 
OF  THE  HEALTH  CARE  CEA/CBA 

Chapter  3  and,  to  a  lesser  extent,  chapter  2  of 
this  volume  are  based  in  large  part  on  an  exten- 
sive review  of  the  health  care  CEA/CBA  litera- 
ture. A  detailed  descriptive  analysis  of  the  com- 
position of  that  literature,  including  trends  over 
time,  is  presented  in  appendix  A.  A  portion  of 
that  analysis  is  presented  here,  however,  as 
background  for  chapters  2  and  3. 

A  bibliography  on  CEA/CBA  in  health  care  is 
presented  in  appendix  B.  This  bibliography  con- 
tains approximately  600  references,  primarily 


LITERATURE 

from  the  years  1966  through  1978.  OTA's  anal- 
ysis of  this  literature  shows  a  clear  and  dramati- 
cally growing  interest  in  health  care  applications 
of  CEA/CBA.  As  described  in  appendix  A,  each 
of  the  references  was  classified  according  to  the 
following  dimensions:  1)  year  of  publication,  2) 
type  of  analysis  (CEA  or  CBA),  3)  publication 
audience,  4)  medical  function  of  the  technology, 
5)  physical  nature  of  the  technology  (drug,  de- 
vice, etc.),  6)  decision  orientation  (e.g.,  societal 
perspective),  and  7)  subject  matter.  Only  a  mi- 
nority of  the  bibliographic  citations  are  actual 
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CEA/CBAs.  The  majority  address  CEA/CBA 
or  CEA/CBA-related  issues.  Several  citations, 
however,  are  connected  to  CEA/CBA  only 
through  their  titles;  their  actual  content  is  either 
cost  or  effectiveness  related  alone. 

Widespread  interest  in  health  care  CEA/CBA 
seems  to  be  a  phenomenon  of  the  1970's.  Figure 
1  shows  the  growth  in  the  numbers  of  published 
CEA/CBAs  and  the  numbers  of  CEA/CBA-rele- 
vant  articles.  This  growth  has  greatly  surpassed 
the  increase  in  the  overall  medical  literature. 
Figure  2  shows  that  the  growth  has  been  espe- 
cially rapid  in  medical  journals  as  compared  to 
nonmedical  health  care  journals.  This  trend  is 
suggestive  of  an  increased  economic  conscious- 
ness on  the  part  of  physicians,  but  it  does  not 
allow  any  firm  conclusion  to  that  effect. 

Prior  to  1975,  the  annual  number  of  CBAs 
generally  exceeded  the  number  of  CEAs.  The 
reverse  has  been  true  since  then.  The  reasons  for 
this  shift  are  difficult  to  determine.  Some  dis- 
cussion of  possible  explanations  is  included  in 
appendix  A,  and  an  examination  of  the  differ- 
ences between  CEA  and  CBA,  and  the  implica- 
tions of  those  differences,  can  be  found  in  chap- 
ters 2  and  3. 

Analysis  of  the  literature  by  medical  function 
of  the  technology  under  study  shows  that  pre- 
vention and  diagnosis  each  account  for  slightly 
over  a  quarter  of  the  references,  with  treatment 
accounting  for  the  remaining  44  percent.  Re- 
cently, however,  there  has  been  a  shift  away 
from  studies  of  prevention,  which  dominates  the 
other  two  categories  in  the  earlier  years,  and 
toward  those  of  diagnostic  technologies  and 
treatment  technologies.  (See  table  1.)  In  terms  of 
decision  orientation,  health  care  CEA/CBAs  re- 
tain as  their  principal  orientation  a  societal 
perspective  on  problems,  though  studies  with  an 
individual  practitioner  orientation  seem  to  be 
becoming  increasingly  common. 

Given  the  strength  of  recent  growth  in  the  lit- 
erature and  social  forces  promoting  future  con- 
sciousness of  cost  effectiveness,  OTA  antici- 
pates continued  significant  growth  in  the  litera- 
ture over  the  next  several  years,  particularly  in 
the  medical  literature.  It  is  possible  that  the  rela- 
tive preference  for  CEA  over  CBA  will  increase. 


Table  1.— Numbers  of  Health  Care  CEA/CBAs 
by  Medical  Function  and  Year  (1968-78) 


Number  of  CEA/CBAs  by  Medical  Function 


Prevention 

Diagnosis 

Treatment 

Other3 

Year 

(1) 

(2) 

(3) 

(4) 

1966. . . . 

0.0 

0.0 

0.0 

5 

1967. . . . 

0.0 

0.3 

1.7 

3 

1968. .  .  . 

2.5 

3.0 

3.5 

6 

1969. .  .  . 

1.5 

0.5 

2.0 

2 

1970. . . . 

3.0 

2.0 

3.0 

8 

1971  

6.5 

3.5 

4.0 

11 

1972  

7.0 

2.0 

4.0 

14 

1973. . . . 

14.5 

4.0 

10.5 

15 

1974. . . . 

2.5 

5.0 

14.0 

22 

1975  

5.0 

10.0 

14.5 

22 

1976. . . . 

15.0 

16.0 

28.0 

33 

1977. . .  . 

12.5 

17.0 

37.5 

35 

1978. . .  . 

18.0 

25.5 

18.5 

31 

Total 

88.0 

88.8 

141.2 

207 

includes  mixes  of  all  three  functions  (prevention,  diagnosis,  and  treatment), 
administration,  general,  and  unknown. 

SOURCE:  Office  of  Technology  Assessment. 

Concern  with  the  cost  effectiveness  of  technol- 
ogy has  motivated  much  of  the  recent  CEA/ 
CBA  work  in  health  care,  and  this  motivating 
concern  probably  will  persist  for  several  years. 

The  single  disease  class  that  has  captured  the 
most  attention  in  the  literature  is  also  the  Na- 
tion's current  leading  cause  of  death:  cardiovas- 
cular disease  (CVD).  More  than  two  dozen  pa- 
pers in  the  bibliography  concern  CVD,  and  an 
additional  16  citations  relate  to  hypertension 
screening  and  treatment.  Other  major  disease 
problems  have  also  received  considerable  atten- 
tion. Cancer  screening  programs  have  been  the 
subject  of  over  20  papers,  including  9  on  breast 
cancer  screening  (27,95,230,267,303,313,375, 
376),  although  cancer  treatment  per  se  has  not 
received  attention.4  Eighteen  papers  have  ad- 
dressed mental  illness  problems  and  programs 
(31,99,113,218,223,351,352,353,369,414,580), 
and  18  others  pertain  to  dental  care  (49,59,75, 
126,127,187,229,245,283,331,390,518).  Drug 
abuse  (24,186,225,243,265,266,269,278,326, 
328,358,444,464,486)  and  alcoholism  (259,268, 
281,474,532)  combined  account  for  a  similar 
number  of  references.  Renal  disease,  the  subject 
of  18  papers,  has  received  attention  dispropor- 

4Primary  prevention  of  cancer  also  has  received  no  attention  in 
this  literature,  but  many  opportunities  for  primary  prevention  lie 
outside  of  the  conventional  personal  health  care  system.  Studies  of 
the  costs  of  air  pollution,  for  example,  and  of  the  benefits  of  abate- 
ment do  concern  themselves  with  cancer  prevention. 
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Figure  1.— Diffusion  of  Health  Care  CEA/CBAs  by  Year(1966-77) 


_l  I  I  I  I  I  I  I  I  I  I  I 

1966        1967        1968       1969        1970        1971        1972        1973        1974        1975       1976  1977 


Year 

Key:  —  Number  of  CEAs  +  CBAs  per  year,  from  column  3  of  table  A-2,  app.  A 

—  —  —  CEAs  +  CBAs  +  related  papers  per  year,  from  column  5  of.table  A-2,  app.  A 

SOURCE:  Office  of  Technology  Assessment. 
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Figure  2.— Diffusion  of  Health  Care  CEA/CBAs  in  Medical  and  Nonmedical  Health  Care  Journals 

by  Year  (1966-77) 


1966        1967        1968       1969        1970        1971        1972        1973       1974       1975        1976  1977 

Year 


Key:   CEAs  and  CBAs  in  medical  journals,  per  year  (from  column  1,  table  A-3,  app.  A) 

—  —  —  CEAs  and  CBAs  in  nonmedical  health  care  journals,  per  year  (from  column  3,  table  A-3,  app.  A) 
SOURCE:  Office  of  Technology  Assessment. 
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tionate  to  its  prevalence,  but  reflective  of  the 
political  and  economic  importance  associated 
with  public  funding  of  dialysis  (80,146,298,327, 
361,363,367,459,471,520).  The  Federal  Govern- 
ment's mid-1960's  interest  in  disease  control 
programs,  and  in  kidney  disease  in  particular, 
made  this  the  only  disease  problem  to  have 
more  than  one  citation  in  the  period  prior  to 
1969. 

Two  general  classes  of  health  problems — 
communicable  diseases  and  birth  defects — have 
captured  considerable  attention.  A  variety  of 
communicable  diseases  (including  cholera,  in- 
fluenza, malaria,  measles,  polio,  rubella,  tuber- 
culosis, and  venereal  disease)  have  been  the  sub- 
ject of  over  two  dozen  papers  (1,23,65,100,101, 
160,173,180,289,297,368,377,406,438,461,472, 
473,506).  Since  the  detection  and  treatment  of 
communicable  disease  have  distinct  "public 
goods"  characteristics,5  they  are  logical  subjects 
for  CEA/CBA,  and  it  is  not  to  surprising  to  find 
that  half  of  all  the  communicable  disease  papers 
date  from  before  1974.  By  contrast,  another 
class  of  problems — the  prevention  of  birth  de- 
fects— has  been  studied  much  more  in  recent 
years,  with  only  2  of  15  papers  predating  1974 
(34,114,  221,246,370).  Several  birth  defect  dis- 
ease problems  have  received  isolated  attention 
(e.g.,  Down's  syndrome,  spina  bifida,  Tay- 
Sachs  disease),  but  at  least  one — phenylketo- 
nuria— has  been  the  subject  of  three  studies 
(78,517,553). 

Several  disease  problems  emerge  in  the  guise 
of  surgical  procedures  intended  to  treat  them. 
Each  of  the  following  operations  is  the  focal 
point  of  at  least  one  reference  in  the  bibli- 
ography: radical  cystectomy  (63),  tonsillecto- 
my (68),  cholecystectomy  (191),  herniorrhaphy 
(222,394),  appendectomy  (398),  synovectomy 
(416),  joint  replacement  (534),  and  hysterecto- 
my (103,275).  In  addition,  there  is  a  large  num- 
ber of  papers  relevant  to  surgery  and  CEA/ 
CBA  but  not  identifiable  with  a  specific  surgical 


5The  technical  economic  problem  is  one  of  significant  externali- 
ties: These  diseases  are  public  health  problems  because  of  their 
communicability,  and  their  prevention,  for  example  through  im- 
munization, confers  benefits  on  people  other  than  the  immediate 
recipient  of  the  prevention  measure.  Thus,  society  has  an  interest 
in  immunizing  individuals  that  goes  beyond  the  private  interest  of 
those  individuals. 


procedure  (3,39,40,74,214,231).  Many  of  the 
surgery-related  papers  were  contributions  to  a 
recent  book  on  the  subject  (73). 

Close  to  30  papers  were  classified  as  nonspe- 
cific screening  and  prevention  (43,87,105,106, 
107,109,133,157,158,227,239,309,320,362,428, 
455,458,478,484,489,497,535).  Some  of  these 
related  to  particular  activities  (e.g.,  multiphasic 
screening  (87,105,106,107)),  while  others  dis- 
cussed CEA/CBA  issues  more  generally. 

In  recent  years,  a  great  deal  of  policy  discus- 
sion and  regulatory  activity  has  concentrated  on 
the  adoption,  diffusion,  and  use  of  expensive, 
sophisticated  capital  equipment.  Thus,  it  was 
with  considerable  interest  that  OTA  explored 
whether  such  equipment  had  been  the  focal 
point  of  numerous  CEA/CBAs.  With  one  excep- 
tion— the  computed  tomography  (CT)  scan- 
ner— the  answer  is  a  striking  no.  The  CT  scan- 
ner was  the  most  talked  about  medical  technol- 
ogy of  the  1970's,  and  both  the  quantity  and  na- 
ture of  the  general  interest  are  reflected  in  the 
CEA/CBA  literature  on  CT.  Some  18  citations 
are  on  this  technology,  all  but  2  of  them  pub- 
lished in  1977  and  1978  (2,26,28,32,42,83,166, 
167,169,211,300,301,317,408,527,541,559,594). 

Will  other  equipment-embodied  technologies 
emerge  as  the  subject  of  much  attention  in  the 
literature?  As  the  controversy  on  specific  tech- 
nologies grows,  particularly  related  to  their  cost 
implications,  additional  CEA/CBA  papers  can 
be  anticipated.  Electronic  fetal  monitoring  is  an 
example  of  one  such  technology  which  has  al- 
ready been  the  subject  of  several  papers  (34,35, 
435,436).  The  work  of  the  National  Center  for 
Health  Care  Technology,  combined  with  gener- 
al interest  and  concern,  might  increase  the  pro- 
portion of  CEA/CBA  literature  focusing  on 
equipment-embodied  technologies. 

A  variety  of  services  accounted  for  a  signifi- 
cant proportion  of  the  articles.  Some  of  these 
services  have  relatively  tangible  outcomes  and 
hence  are  good  candidates  for  CEA/CBA.  Six 
studies  of  pharmaceutical  services  basically  in- 
volve issues  of  efficiency,  with  equity  concerns 
of  less  importance  (20,357,592,599).  Aside  from 
moral  considerations,  some  studies  related  to 
reproductive  health  lend  themselves  to  reason- 
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ably  objective  analysis.  An  obvious  example, 
abortion,  was  the  subject  of  only  one  paper  dur- 
ing the  period  covered  (338),  though  continued 
policy  debate  and  development  may  lead  to  in- 
creased analytical  interest  (84).  In  addition,  the 
literature  review  yielded  several  articles  on 
family  planning  and  on  maternal  and  child 
health  programs. 

Other  services  address  social  needs  that  are 
extremely  difficult  to  quantify  in  a  meaningful 
fashion.  In  general,  one  would  expect  that  such 
services  would  not  receive  a  great  deal  of  atten- 
tion in  literature  which  places  a  premium  on 
quantification  and  measurement.  Exceptions 
most  likely  would  reflect  a  policy  of  unusual 
social  importance.  Above,  it  was  noted  that  18 
CEA/CBA-relevant  articles  in  the  mental  health 
area  were  found.  Similarly,  there  were  a  dozen 
papers  on  geriatric  services  (148,149,286,319, 
568),  and  an  additional  four  papers  on  institu- 
tional versus  home  care,  with  the  patient  type 
not  indicated  (121,321,348,486).  Given  current 
problems  and  anticipated  growth  in  the  elderly 
population,  continued  interest  in  this  subject 
matter  would  not  be  surprising.  Two  other 
areas  of  considerable  current  interest  are  oc- 
cupational health  and  rehabilitation.  The  liter- 
ature search  identified  more  than  10  articles  on 
relevant  topics  (21,61,89,111,112,141,174,175, 
270,373,423,546). 

Program  services  is  not  the  only  area  in  which 
social  importance  recommends  analysis  while 
quantification  problems  limit  it.  Manpower 
programs  illustrate  another  area  in  which  tech- 
nical innovations — often,  in  this  case,  substitu- 
tion of  one  type  of  personnel  for  another — pro- 
duce outcomes  which  are  difficult  to  quantify 
usefully.  Nevertheless,  analysts  have  made  a 
dozen  contributions  on  this  subject  (82,90,120, 
142,226,316,374,437). 

Related  to  the  dearth  of  equipment-specific 
studies,  relatively  few  diagnostic  procedures, 
apart  from  screening  procedures,  have  been  the 
subject  of  CEA/CBA  attention.  A  few  proce- 
dures have  received  isolated  discussion — for  ex- 
ample, fiberoptic  laparoscopy  and  colonoscopy 
(224),  sigmoidoscopy  (581),  and  gastrointestinal 


exams  (207) — but  only  radiology  has  received 
frequent  attention  (2,26,28,32,42,83,166,167, 
169,211,300,301,317,408,430,431,433,527,541, 
559,594).  Weinstein  (569)  has  identified  the 
evaluation  of  diagnostic  procedures  as  deserv- 
ing of  CEA/CBA  efforts.  His  plea  is  supported 
by  the  growing  body  of  literature  which  indicts 
the  increasing  use  of  diagnostic  tests  as  a  major 
source  of  medical  cost  inflation  (752).  The  evi- 
dence suggests  that  everyday,  mundane  tests  are 
at  least  as  significant  contributors  to  that  infla- 
tion as  the  more  sophisticated  and  expensive 
technologies  (745),  yet  the  former  have  received 
very  little  CEA/CBA  attention.  Again,  prob- 
lems of  measuring  and  valuing  the  outcomes  of 
diagnostic  procedures  stand  in  the  way  of  ready 
application  of  CEA/CBA  (360,559). 

In  closing  this  section,  two  other  areas  which 
seem  underrepresented  in  the  literature  should 
be  mentioned.  For  the  last  several  decades, 
drugs  have  epitomized  the  scientific  growth  of 
medicine  and  dramatically  altered  the  practice 
and  outcomes  of  health  care.  Drugs  have  been 
the  subject  of  hundreds  of  biochemical  and  med- 
ical studies,  and  within  the  social  sciences,  of 
numerous  analyses  of  medical  technical  change. 
Yet  aside  from  implicit  and  tangential  interest  in 
them  (e.g.,  as  a  component  of  hypertension 
management),  drugs  have  not  often  been  the 
subject  of  CEA/CBA  analysis.  (See,  however, 
reference  190  for  a  case  study  on  cimetidine.) 

Finally,  the  literature  reveals  very  little  evi- 
dence of  attempts  to  compare  the  costs  and  ben- 
efits (or  effectiveness)  of  specific  medical  in- 
terventions with  nonmedical  interventions  to 
deal  with  health  problems.  Although  this  back- 
ground paper  focuses  on  medical  approaches, 
one  might  have  anticipated  identification  in 
OTA's  literature  search  of  a  few  studies  which 
cross  the  medical-nonmedical  border.  With  the 
exception  of  early  Department  of  Health,  Edu- 
cation, and  Welfare  efforts  (240),  however, 
studies  of  this  type  were  not  found.  Conceiv- 
ably, heightened  awareness  of  prevention  alter- 
natives (743)  will  motivate  formal  efforts  to 
grapple  with  medical-nonmedical  comparisons 
in  the  future. 
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DECISION  TECHNIQUES  RELATED  TO  CEA/CBA 


Other  bodies  of  literature  are  related  to  the 
application  of  CEA/CBA  in  health  care,  but 
OTA,  in  the  attempt  to  set  reasonable  bounds 
for  this  inquiry,  did  not  systematically  explore 
these.  For  example,  more  attention  could  have 
been  given  to  the  areas  of  decision  analysis, 
multiple  objective  programing,  and  health 
status  indexes  (HSIs).  In  all  three  of  these  areas, 
there  is  a  rich  and  growing  health-related  litera- 
ture. In  omitting  them  during  our  literature 
search,  OTA  did  not  identify  some  applications 
specifically  related  to  CEA/CBA  in  health  care. 
Each  area  will  be  considered  briefly  below. 

Decision  analysis  is  a  collection  of  analytical 
methods  used  to  assist  in  making  decisions  un- 
der uncertainty.  This  technique  commonly  uses 
the  familiar  decision  tree  diagram,  depicting  al- 
ternative decision  pathways  (or  "branches") 
each  of  which  is  accompanied  by  a  probability 
that  a  certain  event  will  occur  (335,558).  Since 
CEA/CBA  studies  ordinarily  include  many  un- 
certain variables,  some  element  of  decision  anal- 
ysis may  often  be  desirable,  as  is  discussed  by 
Schweitzer  (478).  (For  an  excellent  review  of  de- 
cision analytic  application  to  health  care,  see 
reference  735.) 

Multiple  objective  (or  multiobjective)  pro- 
graming is  another  field  of  study  whose  applica- 
tion may  be  important  to  the  use  of  CEA/CBA 
in  the  health  field,  but  which  has  received  rela- 
tively little  attention  partially  because  the  gen- 
eral field  itself  is  quite  new.  Multiobjective  pro- 
graming is  a  subfield  of  mathematical  program- 
ing, which  in  turn  lies  within  the  discipline  of 
operations  research.  For  a  comprehensive,  but 
non-health-related,  discussion  of  the  subject,  see 
Cohon,  1978  (719).  Essentially,  multiobjective 
programing  consists  of  a  set  of  analytical  tech- 
niques, such  as  linear  programing,  which  at- 
tempts to  find  solutions  to  a  problem  which  has 
more  than  one  objective.  The  rationale  behind 
the  use  of  these  techniques  is  that  many  prob- 
lems— especially  public  policy  ones — which  re- 
quire decisions,  have  multiple  objectives,  many 
of  which  may  be  conflicting.  That  is,  by  achiev- 
ing one  objective,  another  objective  must  be  sac- 
rificed. The  purpose  of  multiobjective  program- 


ing in  public  policy  decisionmaking  is  for  the 
analyst  to  provide  the  decisionmaker  with  op- 
tions and  their  probable  consequences.  As  Co- 
hon describes  it  (719),  when  a  problem  is  solved 
for  a  single  objective,  and  when  there  actually 
are  multiple  objectives,  one  of  two  undesirable 
events  is  apt  to  occur:  Either  some  objectives  are 
ignored,  and  therefore  treated  as  if  their  value 
were  zero;  or  the  analyst,  in  an  attempt  to  com- 
bine objectives,  assigns  relative  weights  to 
them.  Either  of  these  actions  results  in  the  ana- 
lyst's actually  making  the  key  decisions  which 
are  supposed  to  be  made  by  the  decisionmaker. 
In  multiobjective  programing,  by  contrast,  the 
analyst  describes  the  degree  to  which  each  ob- 
jective is  or  is  not  met  as  a  result  of  each  course 
of  action.  With  the  analytic  process  accom- 
plished, decisionmakers  are  then  faced  with  the 
political  process  of  deciding  which  course  of  ac- 
tion to  follow. 

HSI  research  is  the  third  field  which  is  not  ful- 
ly assessed  in  this  report.  Nevertheless,  a  pre- 
liminary investigation  suggests  that  the  field  is 
maturing  in  an  orderly,  scientific  manner,  that 
the  body  of  literature  is  growing  fairly  rapidly, 
and  that  HSI  research  holds  significant  promise 
for  future  evaluation  of  all  social  and  techno- 
logical interventions  which  affect  the  public's 
health  status. 

The  Federal  agency  that  has  been  most  in- 
terested in  HSI  research  and  application  has 
been  the  National  Center  for  Health  Statistics 
(NCHS),  whose  job  it  is  to  monitor  and  report 
on  the  Nation's  health  and  whose  Health  Inter- 
view Survey  instrument  has  played  a  key  role  in 
much  of  the  HSI  work  noted  below.  Located 
within  NCHS  is  the  Clearinghouse  on  Health 
Indexes,  an  office  which  maintains  a  current 
computerized  and  indexed  bibliographic  file  on 
all  health-index-related  literature.  Quarterly, 
the  Clearinghouse  publishes  the  "Bibliography 
on  Health  Indexes"  which  includes  annoted 
citations  of  recent  published  and  unpublished 
studies. 

OTA's  preliminary  review  of  the  HSI  lit- 
erature revealed  several  significant  research 
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groups  that  are  active  in  health  status  measure- 
ment. The  San  Diego  group,  working  on  the 
"Health  Index  Project,"  has  done  pioneering 
work  in  developing  both  survey  instruments 
and  relative  weighting  scales  for  physical  health 
measures  which  include  values  for  levels  of  well- 
being  (functional  status  and  symptom-problem 
indicators)  and  disease  transitional  probabilities 
(e.g.,  726,731,732,733,741,742).  Another  group 
is  working  on  the  "Sickness  Impact  Profile 
(SIP)"  study,  which  includes  multiple  weighting 
scales  and  one  overall  scale  for  physical  and  so- 
cial health  as  well  as  general  health  perceptions 


(e.g.,  707,708,728).  A  third  group  at  RAND  is 
developing  multiple  indexes,  using  an  expanded 
definition  of  health,  consisting  of  physical,  men- 
tal, and  social  health  and  general  health  percep- 
tions (79,711).  This  research  effort  is  part  of  the 
RAND  Health  Insurance  Study  and  will  be  used 
to  help  assess  the  impact  that  various  insurance 
mechanisms  have  on  health  status. 

OTA's  discussion  of  the  aforementioned  re- 
search is  not  meant  to  indicate  that  other  re- 
search in  the  area  of  HSIs  is  either  not  being 
done  or  not  being  done  well. 


ORGANIZATION  OF  THE  REPORT 

Chapter  2  examines  issues  relating  to  the 
methodology  of  CEA/CBA,  essentially  orga- 
nized by  the  components  of  analysis.  It  is  ori- 
ented less  toward  describing  the  methodology  of 
CEA/CBA  as  conducted  in  practice  than  toward 
describing  the  components  of  an  ideally  con- 
ceived CEA/CBA  process.  Consequently,  it 
should  not  be  construed  as  a  practical  "cook- 
book" for  use  by  someone  wishing  to  learn  how 
to  "do"  a  CEA/CBA.  Chapter  3  is  a  critical  re- 
view of  the  published  literature  of  CEA/  CBAs. 
It  describes  how  the  components  of  CEA/  CBA 
have  been  addressed  in  actual  practice.  Chapter 
4  contains  OTA's  findings  in  regard  to  the  meth- 
ods of  CEA/CBA.  It  also  includes  a  set  of  10 
principles  of  analysis  developed  by  OTA  to 
guide  an  approach  to  formal  analysis. 


There  are  five  appendixes.  Appendix  A  is  an 
analysis  of  the  growth  and  composition  of  the 
health  care  CEA/CBA  literature.  Appendix  B  is 
a  bibliography  of  CEA/CBA  in  health  care.  It 
includes  a  discussion  of  the  criteria  for  inclusion 
of  items  in  the  bibliography.  Appendix  C  is  a 
collection  of  abstracts  of  items  in  the  bibliogra- 
phy of  appendix  B,  including  the  19  case  studies 
of  medical  technologies  prepared  as  part  of 
OTA's  full  assessment,  The  Implications  of 
Cost-Effectiveness  Analysis  of  Medical  Technol- 
ogy. A  brief  description  of  the  main  report  and 
other  background  papers  of  OTA's  assessment 
is  presented  in  appendix  D.  Appendix  E  lists  the 
members  of  the  OTA  Health  Program  Advisory 
Committee  and  the  authors  of  case  studies  con- 
ducted as  part  of  this  assessment. 
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2. 

Methodological  Issues 


INTRODUCTION 

Applications  of  cost-effectiveness  analysis/ 
cost-benefit  analysis  (CEA/CBA)  can  be  quite 
complex,  especially  in  the  field  of  health  care. 
The  effort  to  apply  CEA/CBA,  therefore,  re- 
quires a  systematic  and  often  rigorous  ap- 
proach. The  problem  to  be  solved  may  not  be 
obvious,  nor  may  its  objectives.  Is  the  problem 
one  of  health?  If  so,  what  is  its  scope?  Is  the  ob- 
jective to  reduce  deaths?  Or  deaths  due  to  car- 
diovascular disease?  Or  is  the  problem  one  of  ef- 
ficiency? Is  it  to  determine  the  best  way  to  find  a 
cancerous  lesion?  Or  to  lose  weight?  The  an- 
swers to  questions  such  as  these  help  to  deter- 
mine the  scope  and  nature  of  the  analysis. 

The  framework  for  the  analysis  is  also  partial- 
ly determined  by  the  perspective  of  the  evalu- 
ator.  In  reviewing  an  insurance  package  to  eval- 
uate a  preventive  service  for  a  client,  for  exam- 
ple, a  private  health  insurer  probably  would 
limit  his  or  her  concern  to  a  comparison  of  the 
costs  of  providing  the  preventive  service  with 
the  projected  decrease  in  costs  due  to  a  decrease 
in  future  medical  care  utilization.  From  the  per- 
spective of  the  private  health  insurer,  therefore, 
the  problem  has  to  do  with  the  efficiency  of  the 
preventive  program.  The  perspective  of  society 
as  a  whole  is  a  broader  one.  Society's  concerns 
would  necessitate  measuring  not  only  the  direct 
medical  cost  savings  (if  any),  but  also  the  indi- 
rect costs  (such  as  lost  (or  saved)  time  associated 
with  treatment,  recovery,  illness,  or  death)  and 
the  amount  and  value  of  life,  limb,  and  misery 
involved.  The  benefits  derived  by  the  private 
sector,  therefore,  may  be  a  subset  of  or  different 
from  the  benefits  derived  by  society  as  a  whole. 

In  this  chapter,  the  methodologies  of  both 
CEA  and  CBA  are  presented.  First,  the  theoreti- 
cally preferred  orientation  that  a  CEA/CBA 
should  have  is  presented.  Ordinarily,  for  exam- 
ple, a  health  problem  rather  than  a  given  tech- 
nology or  procedure  would  be  an  "ideal"  focus 
of  an  analysis,  because  this  orientation  will 


allow  the  analyst  to  study  alternative  means  to 
achieve  some  specified  health  objective.  Follow- 
ing a  discussion  of  identifying,  measuring,  and 
valuing  benefits/effectiveness  and  costs,  the  im- 
plications of — and  approaches  to — special  prob- 
lems that  confront  the  analyst  are  discussed. 
These  problems  include  valuing  costs  and  bene- 
fits that  occur  over  time,  reducing  uncertainty 
or  making  estimates  in  the  face  of  uncertainty, 
and  taking  into  account  the  concept  of  equity. 
Also  discussed  are  alternative  methods  for 
presenting  findings  and  interpreting  the  results 
of  a  CEA/  CBA.  Finally,  the  inherent  limita- 
tions of  the  technique  are  identified. 

Throughout  this  chapter,  CEA  and  CBA  are 
assumed  to  be  fundamentally  the  same  tech- 
nique, in  that  both  are  structured  methods  that 
are  designed  to  assist  a  decisionmaker  in  the 
allocation  of  resources.  In  actual  practice,  how- 
ever, CBA  attempts  to  measure  all  costs  and 
benefits  of  a  given  process  /technology  and  to 
value  them  in  monetary  terms,  whereas  CEA  or- 
dinarily attempts  to  measure  and  value  the  re- 
sources expended  and  to  compare  them  to  only 
health  status  changes.  In  CEA,  therefore,  the 
final  product  is  usually  presented  in  terms  such 
as  cost  per  life  or  cost  per  year  of  life  saved,  or 
cost  per  degree  of  blood  pressure  lowered,  and 
so  forth.  Although  this  more  limited  approach 
to  assessing  the  worth  of  a  technology  is  often 
practical,  especially  when  the  decisionmaking 
setting  is  limited  in  scope,  a  broader  approach 
to  assessing  the  worth  of  a  technology  may  be 
more  applicable  for  general  public  policy.  For 
instance,  in  the  case  of  a  county  health  depart- 
ment seeking  to  know  the  most  cost-effective 
method  of  controlling  alcoholism,  measures 
such  as  the  cost  per  cured /prevented  alcoholic 
may  be  sufficient  information  on  which  to  base 
a  decision.  However,  at  a  higher  public  policy 
level,  a  local  health  systems  agency,  for  exam- 
ple, may  need  to  set  priorities  among  such  di- 
verse projects  as  an  alcoholism  program,  a 
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health  education  program,  an  immunization 
program,  and  a  mobile  coronary  care  program. 
Its  decision  process  will  require  more  as  well  as 
different  types  of  information,  such  as  the  spe- 
cific populations  affected  in  each  case,  the  rela- 
tive changes  in  health  status,  future  health  care 
expenditures,  reimbursement  possibilities,  and 
political  acceptability.  At  the  national  level, 
even  more  diverse  programs  compete  with  one 
another,  requiring  more  diverse  information 
such  as  changes  in  productivity  (e.g.,  for  alco- 
holism programs),  criminal  activity  (e.g.,  for 
drug  programs),  property  loss,  social  security 
payments,  health  care  expenditures  as  well  as 
health  status.  Therefore,  as  the  policy  perspec- 
tive broadens,  the  information  requirements  for 
resource  allocation  decisions  also  broaden. 

This  chapter  describes  the  methods  of  CEA/ 
CBA  from  a  broad  policy  perspective,  a  per- 
spective which  Congress  will  ordinarily  have. 
The  principal  departure  from  conventional  wis- 
dom is  that  OTA  assumes  that  the  use  of  CEA  in 
public  policy  decisions — like  that  of  CBA — or- 
dinarily requires  a  comprehensive  examination 
of  all  relevant  costs  and  benefits.  In  addition, 
since  CEA  does  not  value  all  variables  in  a  com- 
mon (monetary)  metric  the  way  CBA  does,  it 


will  be  argued  that  the  benefit/effectiveness  part 
of  a  CEA  can  be  analyzed  in  unlike  terms  (e.g., 
money  saved,  population  groups  treated,  and 
disability  days  avoided).  This  approach  has  in- 
herent limitations.  First  of  all,  CEA  so  broadly 
construed  is  contrary  to  what  many  analysts 
consider  CEA  to  be.  Second,  with  the  results  of 
a  CEA  presented  as  the  cost  per  "array"  of 
health  and  nonhealth  benefits/effectiveness, 
such  analysis  will  not  permit  easy  comparisons 
between  programs.  As  stated  in  chapter  1,  how- 
ever, the  position  taken  by  this  report  is  that 
CEA  and  CBA  are  not  decisionmaking  tech- 
niques, but  rather  systematic  methods  to  com- 
pare the  costs  and  significant  effects  of  a  given 
course  of  action. 

This  expanded  concept  of  CEA/CBA  is  not 
meant  to  imply  that  other  more  limited  studies 
are  not  useful  or  valid,  especially  in  resource  al- 
location decisions  of  a  more  limited  scope.  As 
chapter  3  shows,  many  technically  excellent 
analyses  examine  only  the  more  important  ben- 
efits/effectiveness. The  purpose  of  the  expanded 
definition  of  CEA  is  simply  to  place  this  analyti- 
cal technique  in  a  more  general  perspective,  es- 
pecially in  light  of  its  use  in  the  public  policy 
arena. 


DEFINING  THE  PROBLEM,  OBJECTIVES,  AND  ALTERNATIVES 


Ideally,  a  health  care  CEA/CBA  should  start 
with  a  broadly  defined  health  problem  such  as 
premature  death,  excessive  disability,  or  un- 
necessary pain  and  suffering.  A  broad  problem 
definition  would  lead  to  equally  broad  objec- 
tives— to  reduce  premature  deaths,  excessive 
disability,  or  unnecessary  pain  and  suffering. 
Alternative  means  of  achieving  such  broadly 
defined  objectives  are  numerous,  encompassing 
a  wide  scope  of  possible  programs.  In  theory, 
the  programs  need  not  be  limited  to  the  field 
of  health  care  per  se;  alternative  means  of 
enhancing  health  include  airport  safety  pro- 
cedures and  environmental  pollution  control,  as 
well  as  immunization  programs  and  surgical  in- 
terventions. 

In  fact,  the  ultimate  health  care  CEA/CBA 
would  provide  guidance  for  society's  allocation 


of  money  in  order  to  maximize  the  society's 
health  status.  An  approach  this  broad,  how- 
ever, would  require  not  only  technical  sophisti- 
cation beyond  that  of  the  current  methods,  but 
also  the  ability  to  shift  funding  among  widely 
divergent  programs,  such  as  immunization  ac- 
tivities, cancer  research,  emergency  treatment 
systems,  automobile  safety,  and  fire  and  police 
protection. 

Many  public  and  private  health-related  pro- 
grams in  our  pluralistic  society  are,  in  effect, 
fairly  autonomous,  however,  and  shifting  funds 
from  one  program  to  another  is  difficult.  In  the 
real  world,  therefore,  the  identifiable  health 
problem  addressed  through  analysis  may  be 
more  realistically  limited  to  deaths  or  disability 
due  to  a  given  disease.  Limiting  the  scope  of  the 
problem,  in  turn,  limits  the  objectives  and  nar- 
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rows  the  alternatives.  For  instance,  the  problem 
that  is  defined  may  be  confined  to  a  given  dis- 
ease and  the  objective  to  that  of  reducing  the  re- 
sulting deaths  and  disability.  Possible  alternate 
actions  include  preventing  the  disease  as  well  as 
curing  or  ameliorating  it,  but  a  still  narrower 
definition  of  the  problem — such  as  that  of  cur- 
ing existing  disease — would  preclude  preven- 
tion. However,  as  the  scope  narrows,  the  alter- 
native possibilities  can  often  be  examined  in 
greater  depth,  a  counterbalancing  advantage. 

As  a  general  rule,  when  an  analyst  examines  a 
variety  of  alternatives,  time  and  other  limited 
resources  preclude  consideration  of  all  or  even 
many  viable  specific  programmatic  alternatives. 
In  such  cases,  a  possible  strategy  is  to  select 
representatives  of  diverse  programs  (e.g.,  treat- 
ment, screening,  medical  prevention,  nonmedi- 
cal prevention).  Needless  to  say,  the  analyst 
should  select  programs  not  clearly  dominated 
by  others  of  the  same  type.  Thus,  a  comparison 
of  kidney  disease  treatment  with  prevention 
programs  would  not  fairly  represent  the  treat- 
ment end  of  the  spectrum  by  selecting  only  in- 
patient dialysis,  since  both  outpatient  dialysis 
and  home  dialysis  are  viable  options. 

A  CEA/CBA  can  also  start  from  an  entirely 
different  focus.  For  instance,  instead  of  examin- 
ing alternative  means  of  ameliorating  a  societal 
health  problem,  the  analysis  may  consider  the 
ability  of  a  given  technology  to  accomplish  spe- 
cific objectives.  That  is,  rather  than  addressing 
the  general  problems  of  excess  mortality  or  even 
mortality  due  to  heart  attacks,  either  of  which 
could  include  solutions  outside  the  scope  of  the 
health  care  system,  the  analysis  may  examine 
the  cost  of  a  mobile  coronary  care  unit  relative 
to  its  ability  to  reduce  mortality.  This  reduction 
in  scope  may  have  the  advantage  of  allowing 
more  detail,  and  possibly  more  rigor  in  the  anal- 
ysis, but  it  sacrifices  the  ability  to  consider  rele- 
vant alternatives  in  solving  the  overall  health 
problem. 

A  particularly  perplexing  problem  for  CEA/ 
CBAs  concerns  technologies  in  which  a  cause- 
and-effect  relationship  to  health  status  is  not 
established,  although  an  association  is  widely 
believed.  An  obvious  example  is  a  diagnostic 
procedure  (e.g.,  an  X-ray).  In  the  case  of  such 


technologies,  objectives  must  often  be  defined  in 
terms  of  intermediate  outcomes  (e.g.,  number  of 
blood  tests  per  minute  or  amount  or  quality  of 
information  produced).  Analyses  in  which  the 
objectives  are  so  defined  beg  the  question  of  the 
ultimate  value  of  the  diagnostic  procedure,  and 
may  thereby  call  into  question  the  value  of  the 
CEA/CBA  itself. 

For  a  CEA/CBA  to  be  technically  possible, 
the  principal  objectives  should  be  quantifiable; 
when  that  is  not  possible,  reasonable  proxies 
should  be  available.  This  requirement  places  a 
severe  constraint  on  the  evaluation  of  health 
care  procedures,  the  reason  being  that  key  ob- 
jectives are  often  intangible.  Unfortunately, 
such  a  constraint  tends  to  place  analysts  and 
policymakers  in  a  double  bind,  because  health 
resource  allocation  decisions  are  often  required 
irrespective  of  the  ability  to  quantify  objectives. 
When  key  objectives  cannot  be  adequately 
measured,  the  temptation  is  to  measure  only  the 
quantifiable  objectives,  relegating  the  intangi- 
bles to  inconspicuous  footnotes  or  ignoring 
them  altogether.  Thus,  a  hospice  program 
which  may  be  adopted  in  the  absence  of  formal 
analysis,  on  the  basis  of  the  intangible  benefits 
of  dying  with  dignity  and  without  pain,  may  be 
rejected  under  the  scrutiny  of  a  formal,  rigorous 
CEA/CBA,  based  solely  on  economics — since 
the  only  quantifiable  objective  may  be  the  re- 
duction of  health  care  cost. 

The  principal  danger  of  performing  a  CEA/ 
CBA  when  the  important  objectives  are  not 
quantifiable  is  that  the  results  may  be  misrepre- 
sented or  misinterpreted:  That  which  is  quan- 
tified may  take  on  undue  importance;  that 
which  is  not,  regardless  of  its  importance,  may 
be  ignored.  Thus,  not  only  is  it  advantageous 
for  an  analysis  to  be  premised  originally  on  a 
health  problem,  but  the  important  objectives  or 
reasonable  proxies  should  also  be  quantifiable. 
In  structuring  the  analysis,  therefore,  it  is  im- 
portant to  array  the  objectives  in  priority  at  the 
outset,  and  then  to  analyze  the  quantifiability  of 
each  one. 

There  are  at  least  two  exceptions  to  the  above 
statements.  First,  sometimes  a  minor  objective 
by  itself  may  indicate  the  desirability  of  a  pro- 
gram even  when  the  major  objectives  are  not 
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quantifiable.  In  the  case  of  the  hospice  program 
cited  above,  for  example,  although  the  principal 
purpose  may  be  humanitarian  in  nature  and 
thus  impossible  to  quantify  adequately,  medical 
cost  savings,  although  a  much  lesser  considera- 
tion, may  be  sufficient  to  indicate  adoption. 
Notice  that  this  exception  to  the  decision  rule 
applies  in  only  one  direction:  In  the  aforemen- 
tioned case,  the  lack  of  medical  cost  savings 
would  ordinarily  not  be  sufficient  in  itself  to  in- 
dicate rejection.  The  second  exception  arises  in 
the  case  of  a  CEA/CBA  being  performed  from  a 
nonsocial  perspective.  Often,  this  type  of  anal- 
ysis has  an  orientation  strictly  toward  minimiz- 
ing health  care  costs;  hence,  the  broader  societal 
health  objectives  can  be  subordinated  by  a  more 
narrow  economic  concern. 

A  final  note  concerns  the  overall  responsibili- 
ty of  the  analyst  with  respect  to  the  scope  of  the 
study.  On  the  one  hand,  it  is  helpful  if  the  anal- 


ysis provides  information  regarding  the  mar- 
shalling of  resources  in  the  most  efficient  man- 
ner conceivable,  within  the  context  of  society's 
overall  principles,  regardless  of  artificial  con- 
straints, whether  they  be  legal,  political,  or 
customary  in  nature.  Although  some  alterna- 
tives may  not  be  feasible  under  the  present  legal 
structure,  or  may  be  politically  or  economically 
unacceptable,  a  thorough  analysis  might  iden- 
tify them  (e.g.,  see  reference  335).  On  the  other 
hand,  in  the  interest  of  realism,  the  analyst 
should  (when  feasible,  and  to  the  extent  of  the 
analyst's  knowledge)  identify  those  alternatives 
that  are  politically,  legally,  and  economically 
feasible  at  the  present  time.  The  broader  scope  is 
important  for  stressing  what  could  be  accom- 
plished in  the  long  term,  but  often  only  if  society 
is  willing  to  challenge  some  of  its  more  estab- 
lished institutions.  The  narrower  scope  is  im- 
portant for  stressing  what  can  be  accomplished 
in  the  short  run,  given  the  existing  system. 


ASSESSING  PRODUCTION  RELATIONSHIPS 


Just  as  defining  the  problem,  objectives,  and 
alternatives  is  essential  in  establishing  the  over- 
all conceptual  framework  for  the  analysis,  de- 
fining the  process  of  health  care  is  essential  in  es- 
tablishing the  technical  framework  for  the  anal- 
ysis. That  is,  in  order  to  evaluate  the  worth  of  a 
health  care  technology,  we  must  know  the  re- 
sources (people,  money,  equipment,  supplies) 
which  are  used,  the  manner  in  which  they  are 
combined,  and  the  outcome  (the  saving  of  life/ 
limb,  the  increase  in  happiness,  the  decrease  of 
pain  or  of  number  of  hospital  days)  which  is 
produced.  Health  outcome  is  ideally  measured 
in  terms  of  net  changes  in  health  status. 

Often,  there  is  more  than  one  way  to  produce 
a  given  product.  Take  the  relief  of  a  headache  as 
an  example.  The  input  might  be  a  head  and 
shoulder  massage,  an  aspirin,  or  acupuncture. 
As  evidenced  by  the  last  example  (acupuncture), 
sometimes  we  know  how  to  produce  an  output 
without  actually  understanding  the  precise  man- 
ner in  which  it  is  produced.  In  most  cases,  dif- 
ferent inputs  and  varying  amounts  and  combi- 
nations of  the  inputs  result  in  varying  quantities 


and  qualities  of  the  output.  Therefore,  compar- 
ing one  production  process  with  another  can  be 
very  complex. 

In  health  care  CEA/CBAs,  production  rela- 
tionships are  related  to  the  problem  which  is 
defined.  Narrowly  defined  problems  with  inter- 
mediate outcomes  are  the  most  easily  character- 
ized: The  production  of  an  X-ray  or  a  blood  test, 
for  example,  is  reasonably  well  understood;  the 
production  of  a  change  in  health  status  is  not. 
Efforts  to  assess  the  effectiveness  of  health  care, 
therefore,  have  often  avoided  measuring 
changes  in  health  status.  Early  efforts  to  eval- 
uate health  care  measured  the  amount  and  qual- 
ity of  the  inputs,  implicitly  assuming  that  more 
doctors  and  more  nurses  were  better  than  fewer, 
that  board-certified  specialists  were  better  than 
general  practitioners,  newer  facilities  were  bet- 
ter than  older,  and  that  the  latest  technology 
was  better  than  the  existing  technology.  In  1969, 
Donabedian  suggested  that  quality  of  care  be 
measured  in  terms  of  structure,  process,  and 
outcome  (723).  Structure  refers  to  the  inputs, 
process  refers  to  the  manner  in  which  health 
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care  is  practiced  as  defined  by  some  norm  (i.e., 
the  manner  in  which  inputs  are  combined),  and 
outcome  refers  to  the  success  of  health  care  in 
terms  of  health  status.  Most  of  the  subsequent 
success  in  evaluating  health  care  has  been  in  the 
area  of  "process"  evaluation  and  has  taken  the 
form  of  peer  review  and  medical  audit,  such  as 
is  employed  by  the  Professional  Standards  Re- 
view Organizations.  More  recently,  there  has 
been  encouraging  work  in  measuring  outcome 
in  terms  of  health  status  changes  (406,78,79, 
516)  which  has  been  made  possible  by  the  pio- 
neering work  of  several  groups  of  researchers 
who  are  developing  techniques  that  measure 
health  status  (708,726,741). 

Part  of  the  reason  that  the  results  of  health 
care  are  so  difficult  to  understand  is  that  there 
are  numerous  intervening,  or  exogenous,  vari- 
ables which  complicate  the  analysis — variables 
such  as  age  of  patient,  degree  of  patient  com- 
pliance, environmental  changes,  and  genetics. 
As  a  result  of  these  variables,  analysts  some- 
times use  elaborate  mathematical  models  to  try 
to  simulate  both  the  disease  process  and  the  pro- 
duction process  (e.g.,  see  reference  335).  One  of 
the  more  basic  techniques  currently  in  use  is 
decision  theory,  a  diagrammatical  expression  of 
probable  outcomes.  In  some  instances,  when 
outputs  of  a  process  are  known  but  the  process 
by  which  they  are  produced  is  not  well  under- 
stood, analysts  can  make  use  of  operations  re- 
search techniques  which  mathematically  manip- 
ulate the  quantity  of  inputs  and  the  manner  in 
which  they  are  combined  to  "simulate"  the  pro- 
duction and/or  disease  process.  These  methods 
are  known  generically  as  simulation  techniques. 
Despite  the  technical  aura  of  much  of  the  ter- 
minology, simulation  methods  can  be  helpful  in 
simplifying  a  complex  process  into  what  are 
believed  to  be  the  essential  relationships.  They 
can  be  used  to  examine  the  changing  nature  of 
the  outputs  as  both  inputs  and  the  manner  in 
which  they  are  combined  are  varied. 

To  assist  in  public  policy  decisions,  analysts 
may  perform  a  CEA/CBA  by  studying  a  process 
retrospectively,  and  then  extrapolating  the  re- 
sults into  the  future.  In  such  cases,  certain 
potential  complications  should  be  noted.  For  ex- 
ample, many  studies  are  done  on  a  small  scale, 


and  the  observed  input-output  relationships 
cannot  necessarily  be  assumed  to  be  the  same  on 
a  large  scale  (as  any  baker  knows,  quadrupling 
the  ingredients  does  not  successfully  produce  a 
loaf  of  bread  which  is  four  times  the  normal 
size).  An  even  more  complex  problem  is  that  of 
the  rate  of  technological  change.  To  assume  that 
a  complex  technological  process  will  not  change 
over  time  is  obviously  foolish,  but  to  predict 
how  it  will  change  is  fraught  with  uncertainty 
(e.g.,  see  reference  559).  Other  problems  include 
predicting  the  efficiency  gained  by  learning  bet- 
ter how  to  use  a  new  technology,  and  predicting 
relative  changes  in  future  costs  of  inputs  (e.g., 
labor  v.  capital).  Finally,  what  works  in  one  set- 
ting may  not  work  in  another.  A  technology  ap- 
plied in  an  urban  setting  may  not  work  in  a  ru- 
ral one;  a  carefully  controlled  study  in  a  teach- 
ing hospital  may  demonstrate  a  technology's 
efficacy — or  potential  effectiveness — but  may 
not  be  useful  in  predicting  its  actual  effective- 
ness outside  that  special  setting  (405). 

Marginal  Valuations 

The  worth  of  a  technology  should  be  assessed 
at  what  economists  term  "the  margin."  That  is, 
the  analysis  should  seek  to  compare  the  added, 
or  marginal,  cost  of  producing  the  next  unit  of 
benefit  (see  reference  559).  In  an  evaluation  of 
computed  tomography  (CT)  scanning,  the  issue 
is  not  any  longer  whether  the  technology  itself  is 
cost  effective,  but,  rather,  whether  the  various 
applications  of  the  technology  are  cost  effective. 
Should  CT  be  used  for  confirming  suspected 
brain  disease/ trauma,  or  for  ruling  out  brain 
disease/ trauma  when  persistent  headaches  are 
presented?  In  what  instances  are  body  scans 
indicated — or  cost  effective?  In  general,  the 
relevant  inputs  or  costs  which  must  be  consid- 
ered in  a  CEA/CBA  of  a  health  care  technology 
will  be  tied  to  whether  the  technology  is  already 
in  place  or  whether  it  has  yet  to  be  adopted/ 
purchased. 

Joint  Production  Considerations 

Finally,  many  technologies  have  multiple  ap- 
plications, and  the  technological  process  being 
studied  is  seldom  applied  in  isolation.  These  two 
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considerations  can  have  enormous  effects  on 
cost  and  benefit  calculations.  For  instance,  since 
a  single  blood  test  can  be  and  is  often  used  as  a 
source  of  information  for  numerous  diseases 
and  bodily  functions,  analyzing  the  cost  effec- 
tiveness of  drawing  blood  for  only  one  purpose 
is  inadequate  if  the  total  cost  is  used;  it  either 
overstates  the  associated  costs,  understates  the 
potential  benefits,  or  both.  Likewise,  a  CEA  of  a 
Pap  smear  program  should  be  done  in  recogni- 
tion of  the  fact  that  many  other  health  evalua- 
tions are  not  only  possible  but  are  ordinarily 
performed  during  the  examination,  whether  for- 
mally or  informally.  That  is,  the  woman  who  is 
given  a  Pap  test  may  be  screened  for  other  pel- 
vic disorders,  high  blood  pressure,  fever,  skin 
rashes,  weight  problems,  wife  battering,  and 
many  other  conditions,  all  of  which  carry  cer- 
tain potential  benefits  and  all  of  which  should 
be  assigned  some  of  the  cost  (or,  conversely,  less 
cost  should  be  assigned  to  the  Pap  test);  or  the 
CEA  should  be  evaluating  the  complete  ob-gyn 
examination  rather  than  just  a  Pap  test  (335).  Of 
course,  including  the  effects  of  joint  production 
adds  greatly  to  the  problems  of  measurement 
and  valuation,  but  these  difficulties  in  no  way 


diminish  the  conceptual  importance  of  their  full 
consideration  in  a  complete  analysis.  Often,  for 
instance,  a  very  small  incremental,  or  marginal, 
increase  in  cost  to  an  existing  production  proc- 
ess, can  have  large  benefits — other  times,  the  re- 
verse is  true. 

Thus,  in  order  for  the  health  care  production 
process  to  be  adequately  described,  a  causal 
relationship  of  inputs  to  outputs  should  be 
demonstrated,  joint  production  effects  should 
be  considered,  and  the  effects  of  exogenous 
variables  should  be  examined.  In  addition,  the 
analysis  of  the  use  of  an  existing  technology 
should  include  marginal  changes  of  costs  and 
benefits.  Unfortunately,  many  variables  are 
much  easier  to  describe  conceptually  than  they 
are  to  measure  empirically. 

As  mentioned  earlier,  however,  since  many 
diagnostic  procedures  have  intermediate  out- 
comes as  their  objectives,  a  direct  association 
with  health  status  change  may  not  be  known.  In 
such  cases,  if  inputs  and  outputs  cannot  be 
shown  to  be  causally  related,  at  least  an  associa- 
tive relationship  (however  distant)  to  some 
health  problem  should  be  noted. 


IDENTIFYING,  MEASURING,  AND  VALUING 
BENEFITS/EFFECTIVENESS  AND  COSTS 


At  the  heart  of  every  CEA/CBA  is  the  identi- 
fication, measurement,  and  valuation  of  rele- 
vant costs  and  benefits/effectiveness  associated 
with  the  production  process.  The  identification 
and  measurement  procedures  for  both  tech- 
niques are  essentially  the  same;  it  is  in  the  val- 
uation process  that  the  two  techniques  differ. 
The  reader  will  recall  that  CBA  ordinarily  re- 
quires that  all  costs,  effects,  and  benefits  be  val- 
ued in  monetary  terms,  whereas  CEA  requires 
that  only  nonhealth  status  changes  be  so  valued. 
But  there  are  other  differences  between  the  two 
techniques. 

One  of  the  inherent  difficulties  in  describing 
the  elements  of  both  CBA  and  CEA  simultane- 
ously— as  is  done  in  this  report — is  that,  despite 
conceptual  similarities  of  the  two  methodolo- 
gies, details  sometimes  differ  for  technical  rea- 


sons. The  classification  of  costs  and  benefits/ef- 
fectiveness is  one  example.  It  is  convenient  to 
look  on  "costs"  as  those  resources  which  one 
must  give  up  in  order  to  gain  some  benefit  or  de- 
sired effect.  Conversely,  benefits  are  those  re- 
sources which  are  gained  from  the  expenditure 
of  other  resources  used  to  produce  them.  These 
definitions  hold  for  the  "costs"  of  buying  or  im- 
plementing the  technology  being  assessed  and 
for  the  health  "benefits"  attributable  to  the  tech- 
nology. But  what  about  the  medical  cost  savings 
which  may  result?  Are  they  benefits,  or  are  they 
negative  costs  (i.e.,  to  be  subtracted  from  the 
technology's  cost)?  The  answer  is  either.  In 
CBA,  costs  are  generally  considered  to  be  only 
those  costs  directly  associated  with  the  technol- 
ogy being  assessed  (which  includes  the  expend- 
iture of  "indirect"  costs  such  as  time  and  lost 
productivity).  All  changes  in  resources  resulting 
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from  those  costs,  including  medical  cost  sav- 
ings, are  considered  to  be  benefits,  some  of 
which  are  positive,  some  are  negative.  In  CEA, 
on  the  other  hand,  generally  all  net  medical/ 
health  resource  changes  are  compared  with  all 
net  health  status  changes  (516),  which  requires 
that  medical  cost  savings  be  treated  as  negative 
costs,  rather  than  as  benefits.  In  this  report,  for 
the  convenience  of  exposition,  medical  cost  re- 
ductions will  be  considered  under  the  discussion 
of  benefits. 

In  the  following  two  sections,  both  benefits 
and  costs  will  be  discussed  in  terms  of  their  iden- 
tification, measurement,  and  valuation. 

Benefits/Effectiveness 

Identification 

One  primary  advantage  of  a  CEA/CBA  is  the 
requirement  that  all  relevant  aspects  of  the  use 
of  technology  be  considered  explicitly.  With 
respect  to  the  identification  of  benefits,  this  im- 
plies that  the  analyst  may  look  beyond  the  ob- 
vious, beyond  that  which  is  intended,  some- 
times so  far  beyond  that  the  effects  are  several 
orders  or  generations  away.  The  analyst  should 
look  for  effects  through  not  only  his/her  own 
eyes,  but  perhaps  also  from  the  perspectives  of 
society,  private  individuals,  and  private  institu- 
tions as  well.  That  which  one  person  perceives 
as  a  benefit  or  cost  may  be  perceived  by  another 
in  an  entirely  different  light.  Consider  elective 
hysterectomy,  for  example.  The  patient  weighs 
as  costs  the  financial  costs  plus  the  psychologi- 
cal/physical trauma  against  the  benefits  of  pre- 
venting pregnancy,  uterine  cancer,  or  both; 
whereas  the  health  insurer  may  weigh  only  the 
cost  of  the  operation  with  expected  reduction  in 
future  maternity  or  gynecological  care  costs  (see 
reference  304). 

The  effects  of  technology  in  the  health  field 
can  be  far  reaching  and  varied;  they  can  also  be 
obvious  as  well  as  obscure.  They  often  follow 
directly  from  the  problem  under  consideration, 
the  objectives  specified,  and  the  framework  in 
which  the  problem  is  approached.  Not  all  bene- 
fits or  effects  are  positive — some  may  be  nega- 
tive (e.g.,  deaths  due  to  surgery)  and  some  may 
be  indeterminant  (e.g.,  incurable  disease  may  be 


discovered).  Regardless,  all  effects  should  be 
identified  and  enumerated.  To  identify  all  ben- 
efits/effectiveness, each  of  the  following  cate- 
gories should  be  considered:  1)  personal  bene- 
fits/effectiveness, 2)  health  resource  benefits/ 
effectiveness,  3)  other  economic  benefits/effec- 
tiveness, and  4)  social  benefits/effectiveness. 

Personal  benefits/effectiveness. — The  pri- 
mary purpose  of  health  care  technology  is  to  en- 
hance the  health  and  well  being  of  individuals; 
consequently,  the  expected  benefits/effective- 
ness should  be  examined  in  light  of  individuals' 
personal  health  objectives  such  as  lowered  anxi- 
ety, alleviated  pain,  reduced  risk  of  sickness  or 
death,  enhanced  quality  of  life,  and  so  forth. 
Seldom  will  the  analyst  come  to  the  conclusion 
that  an  individual  has  seen  the  doctor  for  a 
checkup  or  given  up  smoking  in  order  to  save 
future  medical  bills,  which  is  not  to  say  that 
medical  expenses  are  unimportant.  However, 
CEA/CBAs  frequently  attach  great  significance 
to  medical  cost  reduction,  while  often  ignoring 
patients'  personal  motives  (see  reference  304). 

Health    resource    benefits/effectiveness. — A 

direct  result  of  the  use  of  health  care  technology 
is  the  change  in  use  of  other  health  care  re- 
sources. For  instance,  preventive  programs  are 
often  advocated  because  they  are  thought  to  en- 
hance health  and  thus  decrease  future  medical 
expenses.  However,  procedures  such  as  screen- 
ing may  discover  disease  to  such  an  extent  that 
direct  medical  costs  are,  in  the  short  run,  actual- 
ly increased.  This  phenomenon  is  likely  to  be 
observed  when  asymptomatic  individuals  are 
screened  for  socially  latent  problems  such  as  ve- 
nereal disease,  mental  illness,  and  drug  abuse 
and  for  chronic  conditions  such  as  hyperten- 
sion. Regardless  of  whether  future  medical  costs 
are  decreased  or  increased  in  the  aggregate, 
shifts  in  medical  resources  will  almost  certainly 
occur  and  these  shifts  should  be  identified. 

Other  economic  benefits/effectiveness.— Sec- 
ondary effects  resulting  from  changes  in  health 
status  are  often  strictly  economic:  Healthy  peo- 
ple are  more  productive  than  are  sick  people. 
These  effects  should  also  be  identified.  From 
certain  points  of  view,  such  as  the  family's,  soci- 
ety's, or  the  firms',  they  may  be  very  important, 
whereas  from  the  health  insurer's  point  of  view, 
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they  may  be  totally  irrelevant.  Consequently, 
an  efficiency  study  performed  by  a  health  care 
provider  for  an  insurance  firm  may  ignore  such 
economic  considerations;  a  socially  oriented 
CBA/CEA  should  not. 

Social  benefits/effectiveness. — Finally,  soci- 
ety has  collective  objectives  which  stem  from  its 
underlying  values  and  traditions — objectives 
which  are  not  strictly  economic  and  not  directly 
related  to  health  status.  These  objectives  may  be 
concerned  with  the  equitable  distribution  of 
medical  care — ensuring  that  the  poor  have  ade- 
quate access  to  health  services — or  with  protect- 
ing the  rights  of  the  unborn,  the  mentally  ill,  or 
the  comatose  patient.  Also,  health  and  medical 
care  resources  may  be  employed  to  compensate 
certain  of  the  Nation's  citizens  for  the  lack  of 
adequate  housing,  nutrition,  employment,  or 
parental  care.  All  of  these  effects,  intended  or 
not,  should  be  explicitly  identified. 

The  special  case  of  intermediate  outcomes. 

— Notwithstanding  the  ultimate  goal  of  improv- 
ing health  and  welfare,  many  technologies,  par- 
ticularly diagnostic  ones,  can  best  be  evaluated 
only  in  terms  of  intermediate  outcomes  such  as 
blood  counts  per  minute,  clarity  of  X-ray  film, 
or  number  of  pounds  lost  per  week.  This  metho- 
dological limitation  is  an  especially  disturbing 
one,  since  diagnostic  information  often  leads  to 
increased  use  of  other  diagnostic  and  therapeu- 
tic resources,  resulting  in  higher  expenditures 
(569).  There  are,  however,  certain  benefits  from 
diagnostic  technologies  which  can  easily  be 
overlooked:  Such  technologies  often  provide  for 
patient  reassurance;  they  may  avoid  therapeutic 
interventions;  and  they  may  assist  in  furthering 
medical  knowledge.  Health  promotion  pro- 
grams also  are  often  difficult  to  assess  in  terms 
of  improved  health  status,  resulting  in  the 
necessity  of  measuring  intermediate  outcomes. 
Examples  are  weight  control  and  antismoking 
programs. 

Therefore,  when  final  outcomes  resulting 
from  a  health  care  process  cannot  be  adequately 
identified,  intermediate  outcomes  should  be 
identified  and  the  uncertainty  of  the  link  with 
final  health  status  ought  to  be  noted. 


Measurement 

Benefits/effectiveness  initially  should  be 
counted  in  whatever  units  are  most  appropriate: 
Medical  cost  savings/expenditures  are  counted 
in  dollars;  reduced  disability  in  days  (or  weeks, 
months,  years);  reduced  mortality  in  years; 
changes  in  health  status  in  well-years.  Likewise, 
intermediate  outcomes  are  counted  as  number 
of  blood  tests  taken,  number  of  persons  exam- 
ined, and  so  forth. 

Some  benefits/effectiveness  are  difficult  to 
measure  because  they  may  be  only  partially 
known,  or  not  known  at  all.  As  was  discussed  in 
the  section  regarding  the  production  of  health, 
the  efficacy  and /or  effectiveness  of  many  in- 
terventions has  not  been  demonstrated,  and  in 
those  cases  where  it  has,  the  technique  seldom  is 
efficacious  and/or  effective  100  percent  of  the 
time.  In  an  earlier  report  (405),  OTA  found  little 
evidence  that  health  care  technologies  have  been 
adequately  and  systematically  evaluated.  With- 
out valid  efficacy /effectiveness  and  safety  in- 
formation, the  value  of  CBA/CEAs  may  be 
greatly  diminished.  Furthermore,  even  when 
there  is  good  evaluative  research  on  the  technol- 
ogy in  question,  the  information  may  not  be 
directly  applicable  to  the  setting  in  which  the 
technology  will  be  used.  Much  of  the  good  re- 
search is  done  under  nearly  ideal  conditions 
such  as  in  a  controlled  or  partially  controlled 
environment  with  the  best  data  by  the  best  re- 
searchers and  clinicians;  since  applications  of 
the  technology  will  not  normally  have  the  bene- 
fit of  such  conditions,  the  projected  "benefits" 
may  be  significantly  overestimated.  In  any  case, 
probability  theory  and  sensitivity  analysis  can 
be  used  to  embrace  the  concept  of  uncertainty,  a 
subject  which  is  explored  more  thoroughly  in 
another  section  below. 

Unfortunately,  the  intangible  benefits /effec- 
tiveness are  difficult  to  measure,  although  they 
are  often  the  more  important  ones.  The  personal 
and  societal  benefits /effectiveness  listed  above, 
such  as  relief  from  anxiety  and  pain,  for  exam- 
ple, can  often  be  estimated  only  by  indirect 
methods  such  as  patient  satisfaction  question- 
naires, or  by  techniques  which  simulate  an  indi- 
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vidual's  willingness  to  pay  for  the  result.  In  the 
main,  however,  intangible  benefits/effective- 
ness cannot  be  adequately  measured — and  con- 
sequently must  remain  only  "identified."  This 
should  not  eliminate  the  desirability  of  the  ana- 
lyst's including  a  statement  of  their  probable  im- 
portance. 

Valuation 

Valuing  benefits/effectiveness  is  the  next  step 
of  the  process.  Basically,  the  objective  at  this 
stage  is  to  determine  their  worth.  Sometimes  the 
value  is  self-evident,  such  as  when  the  benefit  is 
money  saved.  Since  the  techniques  of  CBA  and 
CEA  are  designed  to  compare  cost  with  benefit 
or  effectiveness,  the  analysis  is  much  easier 
when  both  sides  are  measured  in  money — for  in- 
stance, spending  $100  in  order  to  save  $350  is 
easily  understood.  Many  of  the  applications  of 
health  care  CEA/CBAs  concern  benefits/effec- 
tiveness which  are  not  easily  translated  into 
money,  however,  and  there  is  disagreement  con- 
cerning their  worth.  Some  health  care  technol- 
ogies save  lives,  limbs,  days  of  disability,  and 
discomfort;  other  technologies  produce  infor- 
mation (e.g.,  X-rays  and  laboratory  proce- 
dures). What  are  these  benefits/effectiveness 
worth?  The  answers  seldom  are  obvious. 

Valuation  of  benefits  is  further  complicated 
by  the  problems  of  risk-averseness  associated 
with  individual  preferences.  For  instance, 
McNeil,  et  al.  (736)  demonstrated  that  patients 
preferred  radiation  treatment  over  surgery  for 
lung  cancer  even  though  surgery  provided  the 
better  chances  for  survival.  The  explanation 
given  was  that  the  surgery  itself  carried  with  it  a 
risk  of  immediate  death,  and,  consequently,  pa- 
tients preferred  the  assurance  of  a  certain,  but 
perhaps  shorter,  life  to  facing  the  risk  of  imme- 
diate death.  In  addition,  patients  were  willing  to 
trade  off  a  perceived  increased  quality  of  life 
with  longevity.  Valuing  such  individual  prefer- 
ence is  difficult  and,  even  more  important,  rec- 
ognizing that  they  even  exist  is  easily  over- 
looked. (For  a  more  thorough  discussion  of  risk 
preference  and  risk  behavior,  see  reference  755.) 

The  attempt  to  value  benefits/effectiveness 
often  poses  serious  problems,  perhaps  even 
more  extreme  than  the  problems  their  measure- 


ment poses.  In  those  cases  where  measurement 
is  deemed  impossible,  impractical,  or  unreli- 
able, attempts  to  valuate  may  not  only  provide 
no  further  useful  information,  but  may  actually 
mislead  the  reader  by  implying  that  the  results 
are  more  valid  than  they  actually  are.  An  exam- 
ple of  this  may  be  the  value  of  bereavement  sup- 
port in  a  hospice  program.  This  benefit  can  cer- 
tainly be  identified,  but  it  is  not  easily  meas- 
ured. Attempting  to  place  a  dollar  value  on  it 
would  probably  be  misleading. 

Much  of  the  controversy  surrounding  the  val- 
uation of  health  outcomes  centers  around  the 
value  of  life,  an  issue  which  is  directly  pertinent 
only  to  CBA,  since  CBA  alone  expresses  all 
costs  and  benefits  in  dollars.  The  oldest  and 
most  common  method  of  valuing  life  is  the  so- 
called  "human  capital"  approach,  which  values 
life  in  terms  of  earnings  potential.  The  value  is 
computed  by  summing  the  earnings  lost  due  to 
premature  death  or  to  disability;  conversely,  it 
is  done  by  summing  the  expected  future  earn- 
ings saved  by  postponing  death  or  avoiding  dis- 
ability. All  future  moneys  are  discounted  to  a 
present  value  at  some  specified  rate.  (Discount- 
ing is  discussed  in  another  section  below.) 

One  of  the  first  problems  encountered  by  hu- 
man capital  theorists  was  the  problem  of  con- 
sumption: If,  conceptually,  life  is  valued  in 
terms  of  its  financial  return  to  society,  should 
not  the  individual's  own  consumption  be  ex- 
cluded from  the  benefit  calculation?  However, 
this  solution  would  require  valuing  life  at  zero 
for  those  who  consume  all  they  earn,  and  valu- 
ing life  negatively  for  those  who  deficit  spend. 
Regardless  of  whether  earnings  are  considered 
net  of  consumption,  though,  the  human  capital 
method  is  really  valuing  livelihood — i.e.,  one's 
earning  potential — not  life. 

The  human  capital  approach  also  poses  dis- 
tasteful problems  such  as  valuing  men  more 
highly  than  women,  since  males  have  tradition- 
ally earned  more  than  females.  Likewise,  the 
working  population  is  valued  more  than  the 
very  young  or  the  very  old,  and  whites  more 
than  nonwhites.  In  addition,  this  method  fails  to 
value  other  effects  such  as  the  psychic  costs  of 
death  to  friends  and  relatives. 
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Although  the  human  capital  approach  has  en- 
joyed wide  application  (owing  principally  to  the 
absence  of  a  better  method),  few  people  are  sat- 
isfied that  the  value  of  life  can  truly  be  captured 
solely  by  estimating  earnings  potential.  This  has 
led  to  interest  in  other  methodologies. 

A  conceptually  more  appealing  approach  is 
the  "willingness-to-pay"  technique  (e.g.,  470). 
The  idea  is  to  attempt  to  capture  the  value,  to  an 
individual,  of  reducing  the  risk  of  death  or  dis- 
ability by  small  amounts,  and  using  the  infor- 
mation to  imply  the  value  of  life  itself.  This 
method  has  its  own  conceptual  problem  in  that 
the  imputed  values  are  still  income  related:  A 
rich  person  will  be  willing  and  able  to  pay  more 
to  reduce  the  risk  of  death  than  will  a  poor  per- 
son. Also,  there  is  a  question  as  to  whether  an 
individual  can  understand  what  a  small  reduc- 
tion in  statistical  probability  of  death  means. 
Nevertheless,  the  willingness-to-pay  approach  is 
the  only  technique  that  attempts  to  estimate  in- 
dividual perceptions  as  to  one's  own  worth, 
which,  presumably,  includes  such  diverse  no- 
tions as  personal  values,  risk  averseness,  family 
obligations,  age,  income,  personal  desires,  and 
even  a  philosophical  outlook  on  life.  Despite  its 
conceptual  appeal,  however,  there  is  no  indica- 
tion that  such  a  method  can  arrive  at  a  consist- 
ent value  for  all  human  life.  It  also  ignores  the 
value  of  one's  life  to  others  in  society. 

Other  methods  of  valuing  life  have  attempted 
to  make  use  of  imputed  values  from  life  insur- 
ance holdings  and  from  jury  verdicts.  The 
former  suffers  from  the  same  conceptual  prob- 
lem as  the  human  capital  method  since  "earn- 
ings" not  "life"  is  insured;  the  latter  suffers  from 
gross  inconsistencies  (291).  Neither  method  has 
found  much  acceptance. 

Notwithstanding  the  unending  criticism  of  the 
techniques  to  value  life,  the  concept  is  an  impor- 
tant one.  Klarman  writes  (291): 

As  Mishan  observes,  a  rough  measure  of  a 
precise  concept  is  superior  to  a  precise  measure 
of  an  erroneous  concept.  It  is  agreed  that  the  no- 
tion of  the  value  of  human  life,  apart  from  live- 
lihood, is  sound.  And  a  numerical  estimate  of 
this  value  would  be  useful  in  comparing  how 
worthwhile  alternative  programs  are.  Compari- 
sons of  programs  would  gain  in  relevance  and 


aptness  if  all  benefits  were  counted,  including 
saving  of  human  life  or  gains  in  life  expectancy. 
.  This  potential  gain  is  much  more  likely  to  be  re- 
alized if  all  benefits  are  entered  into  the  model, 
rather  than  having  some  appear  only  in  foot- 
notes. 

CEA  attempts  to  avoid  this  valuation  contro- 
versy by  simply  counting  the  lives  or  years  of 
life  saved  (or  lost)  and  not  transforming  the 
numbers  into  money.  Once  money  is  allocated 
to  save  lives,  however,  the  value  of  life  is  im- 
plied— an  important  point  which  is  easily  over- 
looked. Notice  that  in  CBA,  the  analyst  must 
choose  a  value  to  complete  the  analysis;  in 
CEA,  the  policymaker  chooses  the  value,  albeit 
indirectly.  For  instance,  when  analysts  assess 
competing  life-saving  programs  using  CBA, 
they  must  choose  a  specific  value  (or  range  of 
values)  for  life.  The  most  attractive  program,  in 
terms  of  the  analysis,  is  that  which  computes  to 
have  the  highest  net  benefit;  if  benefits  exceed 
costs,  adoption  of  the  program  would  ordinari- 
ly be  recommended.  Analysts  using  CEA,  how- 
ever, compute  the  cost  per  life  or  year  of  life 
saved.  Although  the  most  attractive  alternative 
is  that  which  provides  the  most  effectiveness  for 
a  given  cost,  the  decision  to  adopt  the  "best" 
program  depends  on  the  implied  value  which 
the  policymaker  places  on  life,  or  on  health 
status  change.  For  instance,  of  several  life- 
saving  programs,  the  most  attractive  may  cost 
$100,000  per  life  saved.  The  decision  to  adopt 
that  program  depends  on  whether  the  policy- 
maker thinks  that  $100,000  per  life  saved  is 
reasonable. 

A  common  misconception  regarding  the  two 
techniques  is  that  CEA  avoids  value  judgments. 
In  fact,  many  value  judgments  are  made,  albeit 
often  implicitly.  These  include  judgments  such 
as  the  equating  of  different  lives — is  a  young  life 
worth  the  same  as  an  old  one?  Judgments  such 
as  the  equating  of  years  of  life — is  1  year  of  life 
for  15  people  equal  to  15  years  for  1  person? 
Judgments  such  as  equating  all  days  of  disabil- 
ity— is  the  day  lost  due  to  the  common  cold 
equal  to  that  lost  due  to  surgery?  Clearly,  CEA 
is  not  value  neutral. 

Time-related  distortions.— Since  many  bene- 
fits/effectiveness of  health  care  technologies  oc- 
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cur  during  widely  varying  intervals  of  time, 
analysts  must  somehow  place  them  in  perspec- 
tive in  order  to  allow  comparisons  to  be  made. 
That  is,  they  must  be  able  to  compare  the  value 
of  reducing  $1  of  medical  cost  today  with  reduc- 
ing it  next  year,  with  saving  a  life  today  with 
saving  it  next  year,  and  so  forth.  The  accepted 
practice  is  to  transform  each  future  effect  to  a 
present  value  by  means  of  a  discount  rate, 
which  is  similar  to  an  interest  rate.  Discounting 
has  long  been  used  for  the  valuation  of  financial 
resources,  but  in  the  health  care  field  it  has  only 
recently  been  applied  to  the  valuation  of  non- 
financial  resources  (78,79,406,572).  (A  more 
complete  discussion  on  discounting  is  presented 
in  a  separate  section  below. ) 

Valuing    multiattributed    outcomes. — As 

noted  previously,  many  individual  processes  in 
health  and  medical  care  produce  widely  diver- 
gent outcomes,  ranging  from  diagnostic  infor- 
mation to  the  relief  of  pain  to  the  prolongation 
of  life.  Not  only  is  each  of  these  outcomes  dif- 
ficult to  measure  (if,  indeed,  the  outcomes  are 
ever  identified)  and  to  value  in  its  own  right,  but 
the  various  outcomes  are  also  difficult  to  com- 
pare with  one  another.  For  instance,  how  much 
pain  is  worth  a  life?  That  would  be  a  difficult 
question  even  if  pain  could  be  accurately  meas- 
ured. Nevertheless,  conceptually,  the  issue  of 
comparing  outcomes  is  important,  and  recently, 
considerable  progress  has  been  made  in  weight- 
ing outcomes  so  that  health  status  changes  can 
be  combined.  In  a  recent  report,  for  instance, 
OTA  used  the  concept  of  quality-adjusted  life 
years  to  evaluate  the  cost  effectiveness  of 
pneumococcal  vaccine  (406).  This  technique  at- 
tempts to  weight  differences  in  health  status  in 
relation  to  good  health.  Thus,  a  day  of  good 
health  is  assigned  the  value  of  "1,"  a  day  of 
death  the  value  of  "0,"  and  days  of  sickness,  de- 
pression, or  disability  values  somewhere  be- 
tween these  extremes.  For  instance,  total  disabil- 
ity may  be  assigned  a  value  of  0.1,  while  a  slight 
disruption  of  daily  life  due  to  the  common  cold 
may  be  assigned  a  value  of  0.9. 

Valuing  intermediate  outcomes. — Above  it 
was  suggested  that  in  certain  cases,  often  when 
evaluating  preventive  or  diagnostic  technol- 
ogies, intermediate  outcomes  may  be  valid  ob- 


jectives, but  their  measurement  begs  their 
worth.  What  is  the  value  of  an  X-ray?  A  blood 
test?  Or  a  physical  examination?  Often,  no  val- 
ue can  be  assigned  to  these  outcomes.  When  this 
is  the  case,  it  is  incumbent  on  the  analyst  to  note 
that  it  is  and  to  state  the  extent  to  which  the 
technology  is  associated  with  final  outcomes  as 
well  as  their  probable  importance  to  the  study's 
result. 

Costs 

Identification 

In  this  report,  the  term  "costs"  refers  to  the 
resources  expended  to  produce  an  intended  ben- 
efit or  effectiveness.  For  instance,  the  costs  of  a 
screening  program  would  include  the  amount  of 
services  provided  (personnel  time,  supplies, 
capital  expenditures),  as  well  as  the  patients' 
time  which  is  forgone  in  the  use  of  the  service. 
Care  should  be  taken  to  identify  all  resources 
which  are  expended  or  which  must  be  expended. 
In  general,  the  concept  of  "opportunity  cost"  is 
the  true  cost  of  a  program.  That  is,  the  cost  is 
equal  to  the  value  of  the  opportunities  which  are 
lost  as  a  result  of  the  investment  in  the  program. 
Initially,  costs  should  be  identified  in  terms  of 
the  actual  resources  used  in  the  production  proc- 
ess— person  hours,  supplies,  and  so  forth.  In 
structuring  the  analysis,  it  is  helpful  to  consider 
costs  as  a  broader  concept  than  simply  financial 
resources. 

Identifying  the  proper  financial  costs  is  al- 
ways easier  conceptually  than  it  is  in  actuality. 
In  the  health  care  field,  this  task  is  even  more 
difficult  because  charges  often  do  not  reflect  true 
costs,  a  fact  which  is  sometimes  due  to  unso- 
phisticated accounting  procedures  and  other 
times  due  to  the  deliberate  subsidization  of  one 
service  by  another.  Hospitals,  for  instance,  are 
known  to  operate  some  services,  such  as  mater- 
nity wards,  at  a  loss  while  operating  certain  an- 
cillary departments,  such  as  diagnostic  labora- 
tories, at  a  profit.  The  same  was  found  true  for 
neonatal  intensive  care  (see  reference  71). 

Also,  since  many  resources  in  the  health  field 
are  often  erroneously  thought  to  be  "free,"  some 
costs  may  be  understated.  A  good  example  is 
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the  cost  of  volunteer  time,  where,  under  the  op- 
portunity cost  concept,  volunteer  time  is  worth 
that  which  is  forgone  by  its  use.  For  example, 
rather  than  working  in  a  hospital  ward,  the  vol- 
unteer may  have  worked  for  the  heart  associa- 
tion. Or  the  service  rendered  by  a  volunteer 
may  ordinarily  be  one  which  the  organization 
must  otherwise  buy. 

In  other  instances,  owing  to  market  imperfec- 
tions, inappropriate  use  of  resources  may  be 
used  which  can  lead  to  the  overstating  of  costs. 
Physicians  giving  immunizations,  registered 
nurses  making  beds,  and  dentists  cleaning  teeth 
are  examples. 

Next,  the  identification  of  the  technological 
resource  costs  will  depend  on  the  stage  of  the 
technology's  development.  For  a  new  technol- 
ogy, costs  may  be  difficult  to  identify,  but 
should  include  the  R&D  costs  as  well  as  the 
capital  costs  associated  with  purchasing  and  op- 
erating the  equipment.  For  an  established  tech- 
nological process,  where  the  analysis  concerns 
the  level  of  use,  marginal  operating  costs  can 
dominate.  One  potential  problem  of  using  past 
performance  to  project  future  costs  is  that  costs 
may  change  as  a  result  of  increased  efficiency, 
technological  change,  or  changes  in  scale. 

Other  reasons  why  costs  are  difficult  to  iden- 
tify are:  1)  some  costs,  such  as  overhead,  are 
common  to  many  products;  2)  some  technolo- 
gies produce  multiple  outcomes — if  the  CEA/ 
CBA  study  concerns  only  one,  the  analyst  must 
somehow  determine  which  costs  must  be  in- 
cluded, which  are  to  be  ignored,  or  how  they  are 
to  be  shared;  and  3)  often,  during  the  produc- 
tion process  other  tasks  are  or  can  be  performed 
at  minimal  incremental  cost. 

Measurement 

Initially,  measurement  should  consist  of 
counting  the  minimum  resources  or  units  of 


service  required  to  produce  the  intended  benefit 
or  effectiveness.  Generally,  this  step  in  the  eval- 
uation will  follow  naturally  from  the  identifica- 
tion process.  In  cases  where  substitution  of  re- 
sources is  possible,  however,  care  must  be  taken 
to  count  the  generic  service  required.  Thus,  the 
number  of  hours  of  immunizations,  of  making 
beds,  and  of  cleaning  teeth  should  be  counted, 
not  the  number  of  physician,  nurse,  or  dentist 
hours  required  to  accomplish  the  respective 
tasks.  The  same  argument  can  be  used  for  meas- 
uring volunteer  time. 

Measuring  costs  when  joint  production  fac- 
tors must  be  considered  is  extremely  difficult, 
often  not  very  reliable,  but  may  be  critical  to  the 
validity  of  the  analysis.  Ignoring  joint  produc- 
tion effectiveness  simply  because  it  is  hard  to 
measure  can  lead  to  a  considerable  overstate- 
ment of  costs. 

Valuation 

Most  analysts  believe  that  valuation  of  costs 
poses  substantially  fewer  problems  than  valua- 
tion of  benefits,  because  many  cost  resources 
have  a  real  or  easily  imputed  market  value.  In 
cases  where  costs  reflect  opportunity  costs  and 
where  they  are  measured  in  dollars,  valuation  is 
essentially  complete,  except  when  the  costs  oc- 
cur during  different  periods  of  time,  in  which 
case  discounting  is  required.  When  costs  are 
measured  in  generic  terms,  such  as  type  and 
amount  of  services  provided,  valuation  can  be 
relatively  difficult  and  sometimes  controversial. 
This  is  because  the  professions  in  the  health  field 
often  successfully  restrict  others  from  perform- 
ing tasks,  which  could  otherwise  be  safely  per- 
formed at  a  more  economical  level  (749).  Never- 
theless, the  analyst  should  critically  evaluate  the 
resources  required  to  accomplish  the  job,  taking 
note  of  political,  legal,  or  technical  constraints 
to  providing  the  service  at  the  most  efficient 
level  possible. 
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VALUING  BENEFITS  AND  COSTS  OVERTIME:  DISCOUNTING 


Costs  and  benefits  seldom  occur  at  the  same 
point  in  time.  But  in  order  for  valid  compari- 
sons to  be  made,  they  can  be  treated  as  if  they 
all  occurred  in  the  present,  through  the  applica- 
tion of  a  method  termed  discounting. 

The  rationale  for  discounting  future  costs  and 
benefits  stems  from  the  fact  that  resources  can 
be  productively  invested  for  future  gains,  as 
well  as  from  the  observation  that  people  expect 
to  be  rewarded  for  postponing  gratification.  For 
instance,  in  order  to  induce  individuals  to  save, 
interest  must  be  paid,  even  in  the  absence  of  in- 
flation. The  rate  of  interest  determines  the  fu- 
ture value  of  the  amount  invested.  Thus,  $100 
invested  at  5-percent  interest  will  become  $105 
in  1  year.  Discounting  is  the  reverse  process: 
$105  next  year  has  a  "present  value"  of  $100 
when  the  discount  rate  is  5  percent. 

Thus,  just  as  an  amount,  p,  invested  at  inter- 
est, i,  has  a  future  value  of: 

p  (1  +  i)  in  year  1 
p  (1  +  i)2  in  year  2 

and 

p  (1  +  i)n  in  year  n 

an  amount  of  money,  p,  n  years  in  the  future  at 
discount  rate,  i,  has  a  present  value  of: 

P 

(1  +  i)n 

Likewise,  a  stream  of  future  benefits  or  costs 
is  the  sum  of  each  amount,  discounted  at  rate,  i, 
from  whichever  year  the  benefit/cost  is  in- 
curred. 

There  is  general  agreement  among  economists 
and  policymakers  that  discounting  future  mon- 
eys is  conceptually  correct.  However,  there  is  no 
consensus  as  to  the  rate  which  should  be  used 
and  there  is  still  some  confusion  as  to  the  proper 


method  of  valuing  future  nonmonetary  bene- 
fits/effectiveness. Fortunately,  when  benefits/ 
effectiveness  occur  over  a  long  time,  almost  any 
discount  rate  used  makes  them  less  and  less  im- 
portant to  the  outcome  of  the  analysis  in  a  fairly 
short  period  of  time  (480).  This  phenomenon  re- 
sults in  making  the  rate  used  and  the  uncertainty 
of  future  events  less  important  than  they  other- 
wise would  be. 

Setting  the  Discount  Rate 

The  particular  rate  chosen  can  have  a  sub- 
stantial impact  on  the  outcome  of  the  anal- 
ysis,since  investment  in  health  programs  often 
means  spending  present  moneys,  which  are  not 
discounted,  for  future  benefits,  which  are.  In 
such  programs,  the  higher  the  discount  rate,  the 
less  attractive  the  program  appears.  As  an  ex- 
ample, suppose  we  spend  $1,000  today,  expect- 
ing to  save  $2,000  in  medical  costs  10  years 
later.  In  order  to  compare  the  expected  benefit 
($2,000  savings)  with  the  costs  of  the  program 
($1,000),  we  must  discount  the  benefit  to  its  esti- 
mated "present  value."  Consider  the  varied  re- 
sults using  different  discount  rates: 


Cost  $1,000  (present  dollars) 

Benefit  $2,000  (in  year  10) 

Discount  Present  value  Present  value  of 

rate  (%)  of  benefit  net  benefit  (B  —  C) 

0  $2,000  $1,000 

5  1,228  228 

7  1,017  17 

10  771  -  228 

And,  if  the  benefit  were  not  realized  for  20 
years,  the  results  would  be: 

Discount  Present  value  Present  value  of 

rate  (%)  of  benefit  net  benefit  (B  —  C) 

0  $2,000  $1,000 

5  754  -  246 

7  517  -  483 

10  297  -  709 
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Many  programs  in  the  health  field  have  even 
longer  benefit  time  horizons.  Thirty  years  is  not 
uncommon,  especially  for  prevention  or  health 
promotion  programs  such  as  antismoking  clin- 
ics and  pap  testing.  Thus,  we  see  the  power  of 
discounting  and  the  resultant  importance  of  the 
choice  of  rate. 

Most  economists  believe  that  the  correct  rate 
is  the  opportunity  cost  of  capital  in  the  private 
sector,  subject  to  certain  adjustments  (e.g.,  the 
adverse  effect  of  pollution  produced  by  private 
sector  investments).  That  is,  society  could  opt  to 
invest  the  money  in  the  private  sector  and  earn 
"benefits"  at  a  substantial  rate  (perhaps  as  high 
as  15  percent)  which  represents  the  opportunity 
that  is  lost  by  investing  in  the  health  program. 

An  alternative  argument,  also  persuasive,  is 
that  the  discount  rate  for  social  programs  is  con- 
siderably lower  than  the  opportunity  cost  of 
capital  since  society's  objectives  include  the 
equitable  distribution  of  benefits  to  future  gen- 
erations. Klarman  (291)  refers  to  this  argument 
as  reflecting  society's  "social  rate  of  time  prefer- 
ence." Referring  to  the  numerical  examples  in 
the  text  above,  the  reader  will  note  that  low  dis- 
count rates  result  in  future  benefits'  appearing 
more  attractive.  That  is,  society  would  more 
readily  invest  money  in  the  present  to  reap  fu- 
ture health  benefits  if  a  low  rate  were  used  (706). 
In  any  case,  whether  the  correct  rate  is  the  pri- 
vate cost  of  capital  or  a  lower  social  rate,  agree- 
ment would  still  not  be  reached  on  the  precise 
number  because  of  the  fact  that  interest  rates 
vary  not  only  across  time  but  also  across  invest- 
ment opportunities  in  any  single  point  in  time. 
In  the  absence  of  agreement,  the  accepted  meth- 
od to  treat  this  uncertainty  is  to  present  the 
results  testing  several  rates — a  technique  gener- 
ally referred  to  as  sensitivity  analysis.  (Sensi- 
tivity analysis  is  discussed  in  a  separate  section 
below.) 

Valuing  Nonmonetary 
Benefits/Effectiveness  Over  Time 

How  does  one  compare  the  value  of  a  life  or  a 
day  of  disability  which  is  saved  in  the  future, 


with  the  same  benefit  which  is  saved  in  the  pres- 
ent? In  CBA,  all  such  benefits  are  transformed 
into  monetary  terms,  a  controversial  process 
discussed  earlier,  and  then  discounted  the  same 
as  any  other  future  financial  asset.  In  CEA, 
however,  benefits  are  expressed  in  nonmonetary 
terms  such  as  lives  or  years  of  life  saved.  Should 
these  be  discounted  as  well?  Weinstein  and  Sta- 
son  (575)  presented  a  persuasive  argument  in  the 
affirmative.  One  way  to  explain  the  need  for 
discounting  future  nonmonetary  benefits  is  to 
assume  no  discounting,  and  for  the  sake  of  clari- 
ty, to  assume  no  inflation.  Consider  a  life- 
saving  program  which  costs  $1,000  and  saves, 
immediately,  10  years  of  life  (i.e.,  $100  is  spent 
per  year  of  life  saved).  Assume  also  a  linear  rela- 
tionship between  costs  and  benefits.  If  that 
$1,000  were  invested  at  5-percent  interest  in- 
stead of  being  spent  on  the  life-saving  program, 
in  1  year  we  would  have  $1,050  which  could  be 
used  to  save  approximately  IOV2  years  of  life;  in 
2  years  there  would  be  $1,102  which  could  be 
used  to  save  over  11  years  of  life;  and  so  forth. 
Therefore,  unless  a  year  of  life  is  valued  more 
highly  in  the  present  than  in  the  future,  the  ra- 
tional decision  will  always  be  to  put  off  spend- 
ing the  money  for  an  additional  year.  Discount- 
ing all  benefits/effectiveness  to  present  values 
avoids  this  irrational  incentive. 

In  conclusion,  then,  although  the  discounting 
of  future  benefits /effectiveness  and  costs  is  con- 
ceptually correct,  there  is  not,  nor  is  there  soon 
likely  to  be,  consensus  regarding  the  rate  for 
two  general  reasons.  The  first  is  technical  in 
nature:  Interest  rates  vary  across  both  time  and 
investment  opportunities.  The  second  is  concep- 
tual: The  discount  rate  can  reflect  the  private 
opportunity  cost  of  capital,  or  a  lower  social 
rate  of  time  preference.  The  results  of  CEA/ 
CBAs  should  be  presented  using  several  dis- 
count rate  estimates  in  order  to  examine  the  in- 
fluence of  the  rate  on  the  results — again,  a  tech- 
nique referred  to  as  sensitivity  analysis,  dis- 
cussed immediately  below. 
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ADDRESSING  PROBLEMS  OF  UNCERTAINTY: 
SENSITIVITY  ANALYSIS 


Discussions  in  the  preceding  sections  have 
noted  the  uncertainty  of  knowledge  regarding 
the  etiology  of  disease  and  regarding  diagnostic 
and  curative  techniques.  Superimposed  on  these 
variables  are  changing  personal  habits,  interac- 
tive environmental  conditions  and  often  unfore- 
seeable future  technological  developments.  In 
addition,  there  is  lack  of  agreement  as  to  the 
magnitude  of  health  status  changes  and  the  val- 
ue of  the  discount  rate.  How  can  we  have  confi- 
dence in  predicting  results  in  the  face  of  all  this 
uncertainty? 

One  possible  answer  is  to  place  the  results  ob- 
tained from  analysis  in  perspective,  to  examine 
closely  the  assumptions  upon  which  the  analysis 
rests,  and  to  test  the  sensitivity  of  the  results  to 
reasonable  changes  in  these  assumptions. 

Uncertainty  can  be  classified  into  that  which 
is  due  to  random  events  and  that  which  is  due  to 
ignorance.  Unfortunately,  many  events  in  the 
health  field  suffer  from  both  types.  The  first, 
random  type,  refers  to  events  which  occur  ac- 
cording to  a  probability  distribution.  In  general, 
these  are  events  associated  with  large  numbers. 
An  example  is  the  number  of  heart  attacks  oc- 
curring in  a  large  population  at  any  given  time. 
This  event  is  thought  to  be  random  and  is  statis- 
tically predictable.  It  is  different  from  the 
chance  of  a  heart  attack  occurring  to  an  indi- 
vidual, which  is  dependent  on  nonrandom  vari- 
ables such  as  a  person's  living  habits  and  genetic 
heritage.  In  some  instances,  events  in  the  health 
field  are  thought  to  be  random,  but  their  prob- 
ability distribution  is  not  known,  which  makes 
prediction  more  difficult. 

The  second,  and  more  troublesome,  type  of 
uncertainty  is  due  to  ignorance.  Sometimes  the 
problem  is  simply  lack  of  information — we  do 
not  know  what  causes  cancer,  or  what  triggers 
certain  allergic  reactions — in  which  case  we 
have  the  option  of  buying  more  information, 
either  through  more  research,  more  time,  or 
both.  In  other  instances,  the  uncertainty  is  due 


to  future  events  over  which  we  have  no  control 
— women  may  smoke  more,  or  there  may  not  be 
an  influenza  epidemic  this  year — in  which  case 
the  best  we  may  be  able  to  do  is  to  examine 
trends  or  use  expert  opinion. 

When  evaluating  a  health  care  technology  or 
program  in  the  face  of  the  unknown,  the  analyst 
has  a  rather  impressive  sounding  arsenal  of 
techniques.  For  random  events,  probability  the- 
ory can  be  used,  often  through  the  application 
of  decision  analysis,  which  is  a  diagraming  of 
the  possible  courses  of  action,  each  branch  ac- 
companied by  a  known  or  imputed  probability. 
When  probabilities  are  not  known,  expert  judg- 
ment can  be  substituted.  Thus,  without  know- 
ing the  cause  or  even  the  dynamics  of  a  given 
random  process,  the  analyst  can  attempt  to  pre- 
dict the  likelihood  of  an  outcome.  But  there  are 
other  techniques  from  the  field  of  operations  re- 
search such  as  Monte  Carlo  and  Markov  Chain 
methods  which  allow  manipulation  of  a  simu- 
lated process  until  the  outcome  mirrors  empiri- 
cal findings  such  as  incidence  rates  of  a  disease 
(see  reference  335).  These  analytical  methods 
can  provide  valuable  insight  as  to  what  process 
may  be  occurring.  They  may  also  provide  a 
false  sense  of  security  to  a  policymaker,  since 
the  terminology  and  the  technical  sophistication 
which  is  required  often  mask  the  tenuous 
assumptions  on  which  the  methodologies  rest. 

Sensitivity  analysis  is  the  examination  of  an 
uncertain  event  under  different  assumptions. 
Earlier  we  discussed  discounting,  concluding 
that  the  precise  discount  rate  was  unknown,  and 
that  a  consensus  may  never  be  reached.  Under 
this  uncertainty,  one  logical  course  for  the  ana- 
lyst is  to  test  the  sensitivity  of  the  results  to  sev- 
eral discount  rates.  For  instance,  one  can  test  a 
low,  high,  and  middle  value — an  approach 
which  is  most  helpful  when  there  is  a  wide  range 
of  reasonable  estimates.  Or  one  can  incremen- 
tally change  the  rate  about  the  suspected  mean 
— an  approach  that  is  feasible  when  the  range  of 
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possibilities  is  relatively  narrow.  In  either  case, 
if  the  results  of  the  study  vary  widely  when  the 
different  values  are  used,  one  can  have  less  con- 
fidence in  any  single  set  of  results.  Conversely, 
if  the  results  change  little,  then  the  precise  rate 
may  be  unimportant.  In  some  CEA/CBAs,  the 
decision  criteria  rest  on  the  rank  order  of  alter- 
natives, not  the  absolute  values  involved,  and 
the  analyst  need  only  determine  whether  the 
ranking  itself  is  disturbed. 

There  are  other  approaches  that  increase  the 
confidence  one  can  place  in  analysis  in  the  face 
of  uncertainty  (744).  For  instance,  a  technique 
known  as  "worst  case  analysis"  can  be  done  by 
assigning  to  the  uncertain  variables  values  that 
least  help  the  program  (i.e.,  which  the  analyst 
believes  to  be  the  preferred  one).  If  the  program 
still  is  preferred,  one  can  have  more  confidence 
in  recommending  it.  Another  method  is  termed 
"break-even  analysis,"  in  which  assumptions 
are  varied  until  some  minimally  acceptable  re- 
sult is  obtained;  one  can  then  ask  whether  the 
assumptions  are  realistic.  For  example,  a  CBA 
requires  a  value  to  be  placed  on  life,  yet  there  is 
no  generally  accepted  value.  The  value  can  be 
varied  upward,  starting  from  zero,  however, 
until  the  analysis  indicates  that  the  program  is 
acceptable;  then  the  value  for  life  can  be  exam- 
ined. Perhaps  it  is  so  low  (say  $1,000)  that  all 
would  agree  that  life  was  worth  at  least  that 
amount.  In  such  a  case,  analysis  can  proceed 


more  confidently  in  the  face  of  the  extreme  un- 
certainty of  this  critical  variable.  In  other  in- 
stances, the  analysis  will  not  indicate  adoption 
of  the  program  unless  a  very  high  value  is 
placed  on  life.  Here,  the  preferred  course  of  ac- 
tion may  not  be  so  apparent.  Techniques  such  as 
worst  case  and  break-even  analyses  are  often 
more  helpful  in  identifying  exceptionally  good 
programs  than  in  ruling  out  bad  ones.  Neverthe- 
less, these  and  other  similar  techniques  can  be 
helpful  in  reducing  uncertainty. 

To  summarize,  sensitivity  analysis  can  pro- 
duce three  important  results: 

1.  It  can  demonstrate  the  substantial  depend- 
ence of  a  conclusion  on  a  particular  as- 
sumption. 

2.  It  can  demonstrate  that  an  assumption 
does  not  significantly  affect  a  study's  con- 
clusion, and  hence  that  the  tenuousness  of 
the  assumption  is  not  a  source  of  concern. 

3.  It  can  establish  a  minimum  or  maximum 
value  which  a  variable  must  have  for  a 
program  to  appear  economically  worth- 
while. 

Finally,  uncertainty  can  often  be  reduced;  it 
should  never  be  ignored.  Results  of  a  CEA/CBA 
should  be  accompanied  by  statements  regarding 
the  confidence  which  the  reader  can  place  in 
them.  A  sensitivity  analysis  is  most  helpful  in 
this  regard. 


EXAMINING  ETHICAL  ISSUES 

Ethical  issues  permeate  both  the  process  and 
the  use  of  CEA/CBAs  in  health  care.  Some  of 
these  issues  have  already  been  touched  on  (e.g., 
valuing  life),  others  have  only  been  hinted  at 
(e.g.,  using  uncertain  information).  In  general, 
there  are  powerful  ethical  arguments  both  for 
and  against  using  CEA/CBA-type  studies  to 
help  make  decisions.  The  arguments  for  using 
CEA/CBA  center  around  the  concept  that 
"some  information  is  preferable  to  no  informa- 
tion," whereas  the  arguments  against  tend  to  be 
based  on  the  actual  or  potential  misuse  of  the 
technique.  Here,  we  will  present  a  brief  discus- 
sion of  the  ethical  issues  involved.  Readers  who 


are  interested  in  a  more  detailed  discussion  of 
this  topic  are  referred  to  appendix  D  of  the  main 
report  of  this  OTA  assessment.  That  appendix 
— "Values,  Ethics,  and  CBA  in  Health  Care" — 
was  prepared  for  OTA  by  the  Hastings  Center. 

Some  of  the  ethical  arguments  against  using 
CEA/CBA  stem  from  the  fact  that  the  delivery 
of  health  care  itself  has  strong  ethical  overtones. 
For  instance,  many  public  policies  are  directed 
at  eliminating  or  reducing  financial  and  social 
barriers  to  health  care.  Because  CEA/CBA  is 
looked  on  by  some  as  a  rationing  mechanism 
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based  on  costs,  there  is  bound  to  be  resistance  to 
its  use. 

From  a  methodological  standpoint,  the  ethi- 
cal arguments  against  using  CEA/CBA  concern 
the  difficulty  in  valuing  that  which  is  often  most 
important:  life,  pain,  happiness.  They  also  con- 
cern the  misuse  of  information.  There  is  the  fear 
that  quantified  variables  will  take  on  undue  sig- 
nificance, and  that  assumptions  will  be  treated 
as  if  they  were  fact.  These  arguments  are  partic- 
ularly compelling  since  both  the  analyst  and  the 
decisionmaker  may  be  responsible  for  such 
problems.  For  instance,  this  assessment  finds 
that  the  process  of  CEA/CBA  is  subject  to  sys- 
tematic methodological  bias,  whereby  a  given 
analysis  can  be  "legitimately"  performed  in  a 
variety  of  ways,  each  of  which  may  affect  the 
interpretation  of  the  results.  In  addition,  the 
policymaker  may  ignore  the  traditional  caveats 
that  are  often,  but  not  always,  provided  by  the 
analyst. 

There  are  also  many  other  inherent  problems 
that  have  ethical  overtones,  such  as:  1)  the  value 
of  a  benefit  may  vary  across  individuals,  or  may 


be  perceived  to  be  different  between  the  indi- 
vidual, society,  or  the  relevant  program  (e.g., 
third-party  payer),  2)  the  value  of  the  benefit 
may  differ  between  generations,  3)  the  value  of 
quality  of  life  is  difficult  to  assess  in  comparison 
with  other  effects  such  as  increased  longevity, 
thus  making  tradeoffs  difficult  to  analyze. 

The  counterarguments — by  those  in  favor 
of  using  CEA/CBA — acknowledge  the  ethical 
problems,  but  say  that  if  used  in  the  proper 
perspective  such  analyses  can  help  by  making 
explicit  the  assumptions  on  which  decisions  are 
based.  The  Hastings  paper  (app.  D  of  the  main 
report)  concludes:  "We  are  persuaded  that,  in  an 
important  sense,  the  defenders  of  cost-benefit 
analysis  are  correct  when  they  argue  that  policy 
decisions  in  the  health  field  are  being  made  daily 
on  shaky  grounds  anyway,  and  that  cost-benefit 
analysis  is  at  least  an  attempt — however  imper- 
fect— to  ground  those  decisions  in  real  needs 
and  real  possibilities.  The  problem  is  not  that 
cost-benefit  analysis  is  not  objective  and  not 
value-free,  but  rather  that  objectivity  and  value- 
freedom  are  unjustifiably  attributed  to  it." 


PRESENTING  AND  INTERPRETING  FINDINGS 


We  have  mentioned  the  limitations  to  which 
most  CEA/CBA  studies  are  subject:  the  uncer- 
tainty of  many  key  variables;  the  difficulty  of 
identification  and  measurement  of  benefits  and 
costs;  the  inability  to  value  and  incorporate 
many  effects,  such  as  ethical  ones. 

Implied  throughout  this  chapter  is  the  tech- 
nical complexity  of  many  studies.  This  type  of 
study  can  lead  to  misinterpretation  of  results 
since:  1)  the  intended  audience  is  often  public  of- 
ficials or  health  care  professionals,  who  may  not 
be  technically  oriented,  and  2)  study  findings 
are  often  reported  in  capsule  form  such  as  a 
news  brief  and  are  often  introduced  in  the  pro- 
fessional literature  in  abstract  form.  Conse- 
quently, the  writers  and  analysts  must  be  par- 
ticularly careful  in  the  way  they  present  the 
results  and  interpret  them  for  the  reader.  The 
presentation  of  the  findings  should  identify  the 


important  variables  and  should  discuss  the  con- 
fidence that  the  reader  can  place  in  the  values 
that  were  used.  A  review  of  the  findings  and  the 
significance  of  the  sensitivity  analysis,  if  used,  is 
ordinarily  necessary  to  place  the  results  of  the 
study  in  proper  perspective. 

There  are  also  certain  technical  considera- 
tions that  can  significantly  alter  the  way  in 
which  a  study  is  interpreted.  The  first  is  the  use 
of  net  benefit  (that  is,  benefit  minus  cost),  rather 
than  the  cost-benefit  ratio  as  a  criterion  to  com- 
pare programs.  The  former  (net  benefit)  ap- 
proach is  usually  preferred,  especially  when  the 
alternative  programs  are  widely  variant  in 
scope.  As  an  illustration,  consider  two  pro- 
grams: 

Program  A  costs  $2,000  and  reaps  gross  bene- 
fits of  $4,000;  program  B  costs  $2  million  and 
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reaps  gross  benefits  of  $3  million.  A  net  benefit 
approach  yields  the  following  results: 

Program  A  Program  B 

$4,000  -  $2,000  =  $2,000    $3  million  -  $2  million 

—  $1  million 

Clearly,  program  B  is  preferred,  given  the  abili- 
ty to  finance  the  project  and  setting  aside  for  the 
example  all  considerations  of  equity  and  distri- 
butional effects. 

However,  a  benefit-cost  ratio  (B/C)  would 
yield  the  following  results: 

Program  A  Program  B 

$4,000     _  $3  million      -  1  5 

$2,000     ~  ~  $2  million 

Now,  program  A  is  clearly  preferred.  Notice 
that  the  ratio  gives  the  reader  no  indication  of 
the  size  of  the  expected  benefits,  nor  the  size  of 
the  program.  Also,  although  program  A  gives  a 
better  rate  of  return  for  the  money  invested, 
there  is  no  reason  to  believe  that  it  can  be  in- 
creased in  scale  and  still  maintain  the  high  rate 
of  return. 

The  B/C  ratio  is  also  sensitive  to  whether  an 
effect  of  a  health  program  is  considered  as  a 
benefit  or  as  a  negative  cost.  In  the  discussion  of 
costs  and  benefits,  it  was  pointed  out  that  med- 
ical cost  savings,  resulting  from  an  investment 
in  disease  prevention/health  promotion,  are 
treated  as  negative  costs  in  a  CEA  (i.e.,  the  "sav- 
ings" are  subtracted  from  the  costs)  and  as  bene- 
fits in  a  CBA.  This  distinction  is  technically  im- 
portant only  when  a  cost-benefit  ratio  is  em- 
ployed; when  costs  and  benefits  are  netted,  it 
makes  no  difference  whether  a  particular  item  is 
considered  a  benefit  or  a  negative  cost. 

The  interpretation  of  an  analysis  can  also  be 
distorted  as  a  result  of  problems  of  scale.  For  ex- 
ample, if  it  is  impossible  to  compare  equal  cost 
or  equal  effectiveness  alteratives  in  a  CEA,  cost- 
effectiveness  ratios  can  be  misleading.  Consider 
the  following  hypothetical  case  presented  in 
tabular  form: 


Lives  saved 
Cost  Program  A        Program  B 

$100,000  10  — 

$200,000  —  15 

C/E  $10,000  per     $13,333.33  per 

life  saved  life  saved 

According  to  the  strict  ratio  rule,  program  A  is 
preferred;  it  costs  less  per  life  saved.  But  if  there 
is  no  possibility  of  replicating  program  A  (i.e., 
saving  another  10  lives  for  an  additional  ex- 
penditure of  $100,000),  might  we  not  prefer  pro- 
gram B?  For  $100,000  more  than  the  cost  of  pro- 
gram A,  it  saves  an  additional  five  lives.  Is  that 
not  a  worthwhile  expenditure?  It  is  at  this  point 
that  the  question  becomes  largely  a  social  or  po- 
litical one.  CEA  has  contributed  information 
which  may  inform  and  assist  social  decision- 
makers, but  it  has  not  produced  an  economical- 
ly preferable  conclusion.  However,  the  CEA 
technique  is  usually  used  to  compare  alternative 
means  to  achieve  some  objective.  In  this  case, 
the  decision  to  invest  has  already  been  made, 
and  the  analysis  is  used  to  choose  the  most  effi- 
cient method.  Thus,  if  the  decision  has  been 
made  to  reduce  deaths  due  to  heart  disease,  the 
cost  per  life  saved  may  be  compared  between 
blood  pressure  screening  programs,  inpatient 
coronary  care  units,  mobile  coronary  care  units, 
and  cardiopulmonary  resuscitation  classes  for 
the  general  public.  Alternatively,  when  operat- 
ing under  a  budget  constraint,  the  number  of 
lives  saved  per  dollar  amount  available  is  com- 
pared between  programs. 

A  related  point  is  that  an  analysis  for  an  ex- 
isting technology  should  be  performed  at  the 
margin.  That  is,  the  additional  cost  of  using  one 
more  unit  should  be  compared  to  the  additional 
benefit  derived.  In  some  instances,  the  addi- 
tional cost  is  so  small  that  one  additional  unit 
will  be  extremely  cost  effective  even  if  the  ex- 
pected benefits  are  small.  In  other  instances,  the 
additional  cost  may  not  be  large  but  the  added 
benefit  is  infinitesimal.  Neither  of  these  subtle, 
but  valuable,  insights  will  necessarily  be  gained 
if  the  analysis  uses  only  average  (as  opposed  to 
marginal)  costs  and  benefits.  A  marginal  anal- 
ysis will  help  to  determine  the  optimal  size  of  a 
program  and  the  point  at  which  a  given  technol- 
ogy is  no  longer  cost  effective  (468,559). 
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LINKING  ANALYSIS  TO  POLICY  IMPLEMENTATION 


As  noted  at  the  outset,  a  CBA/CEA  should 
consider  all  the  relevant  costs  and  benefits/ef- 
fectiveness, regardless  of  to  whom  they  may  ac- 
crue or  when  they  may  occur.  Also,  although  an 
analysis  can  take  on  a  program  or  organization- 
al perspective  as  well,  a  CEA/CBA  is  ordinarily 
performed  from  a  societal  point  of  view.  In 
identifying  the  appropriate  societal  costs  and 
benefits/effectiveness,  these  variables  need  to  be 
viewed  from  perspectives  other  than  that  of  so- 
ciety, in  order  to  make  the  analysis  more  rele- 
vant to  public  policy  decisions. 

It  is  frequently  noted  that  ours  is  a  pluralistic 
society — one  with  many  individuals  and  institu- 
tions making  decisions  tha-t  ultimately  affect  the 
allocation  of  society's  resources.  The  field  of 
health  care  is  no  different.  "Society"  does  not 
make  decisions;  private  consumers,  physicians, 
Congress,  administrators  of  hospitals,  mana- 
gers of  philanthropic  organizations,  and  offi- 
cials of  medicare  or  medicaid  and  of  local  gov- 
ernment agencies,  and  other  people  within  soci- 
ety do.  In  addition  to  considerations  of  societal 
efficiency,  their  decisions  depend  on  such  di- 
verse notions  as  reimbursement  guidelines, 
community  interests,  the  attracting  of  profes- 
sional staff,  intangible  humanitarian  objectives, 
pride,  financial  solvency,  and  sometimes  insti- 
tutional survival  (335,336). 

Also,  because  of  the  manner  in  which  health 
care  in  the  United  States  is  organized  and  fi- 
nanced, there  is  ample  reason  to  believe  that  the 
objectives  of  key  private  individuals  and  institu- 
tions have  an  entirely  different  focus  than  the 
objectives  of  society.  For  instance,  in  health 
promotion /disease  prevention  programs,  costs 


are  often  incurred  by  a  private  party  in  the  pres- 
ent, whereas  benefits  usually  accrue  in  the  dis- 
tant future — and  they  accrue  to  others  as  well  as 
to  the  party  who  funded  the  program. 

On  the  other  end  of  the  spectrum  are  diagnos- 
tic and  therapeutic  procedures.  For  these,  pri- 
vate incentives  tend  toward  overutilization.  The 
procedures  are  often  paid  for  by  insurance  on  a 
fee-for-service  basis;  hence,  increased  utilization 
tends  to  be  financially  rewarding  to  the  provider 
without  being  costly  to  the  patient.  This  situ- 
ation has  given  added  emphasis  to  nonmarket 
controls  such  as  the  certificate-of-need  process 
that  health  systems  agencies  require  of  an  insti- 
tution for  major  capital  investments.  Likewise, 
the  current  interest  in  a  hospital,  or  systemwide, 
revenue  cap  perhaps  stems  in  part  from  the  lack 
of  financial  incentives  toward  cost-decreasing 
technologies  (758). 

All  these  reasons,  then,  lead  to  questioning  of 
the  applicability  of  traditional,  societally  ori- 
ented CEA/CBAs.  The  problem  is  similar  to 
that  of  a  mass  screening  program  when  there 
has  been  made  no  provision  for  treating  discov- 
ered disease.  In  both  cases,  the  information  pro- 
duced is  very  important,  but  is  useless  unless  a 
system  is  in  place  to  use  it.  Just  as  the  answer  in 
the  case  of  the  screening  program  is  not  to  dis- 
card the  screening,  the  answer  in  the  case  of 
CEA/CBA  may  not  be  to  discard  the  technique. 
The  answer  in  part  is  to  make  the  analysis  more 
relevant — by  attempting  to  identify  the  private 
objectives,  and  by  noting  when  they  conflict 
with  and  when  they  support  society's  objectives. 
If  this  is  done  well,  decisions  may  better  reflect 
reality. 
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3. 

Literature  Review 


INTRODUCTION 

Application  of  cost-effectiveness  analysis/ 
cost-benefit  analysis  (CEA/CBA)  to  health  care 
represents  a  fairly  new  endeavor.  The  novelty  of 
CEA/CBA  within  medicine  has  both  positive 
and  negative  reflections.  On  the  one  hand,  the 
growth  in  the  literature  demonstrates  consid- 
erable enthusiasm  for  the  technique;  perhaps 
more  importantly,  it  may  indicate  increasing 
cost  consciousness  within  the  medical  communi- 
ty. Further,  it  might  signal  an  increased  aware- 
ness of  the  idea  that  a  comparison  of  costs  and 
benefits  has  always  been  an  implicit  value  of 
health  care  decisionmaking — and  that  to  allow 
resource  allocation  decisions  to  continue  to  be 
made,  perhaps  unwittingly,  without  more  ex- 
plicit consideration  of  the  costs  in  relation  to 
benefits  is  not  desirable.  On  the  other  hand,  the 
enthusiasm  for  CEA/CBA  is  often  undisci- 
plined, perhaps  reflecting  the  inevitable  growing 
pains  of  any  field  of  inquiry.  The  vast  majority 
of  literature  contributions  whose  titles  identify 
them  as  related  to  CEA/CBA  have  serious  tech- 
nical flaws  or  conceptual  weaknesses  in  struc- 
ture or  interpretation. 

Also  included  in  the  literature  are  many  im- 
portant exceptions  to  this  general  assessment. 
Several  studies  exhibit  both  the  desired  technical 
features  and  the  potential  to  lend  insight  into 
important  issues  of  health  resource  allocation. 
Through  such  examples,  as  well  as  direct  "in- 
struction" (e.g.,  articles  that  review  methods, 
cited  below),  a  small  cadre  of  skilled  practition- 
ers of  CEA/CBA  seems  to  be  providing  the  in- 
tellectual leadership  to  improve  the  general 
quality  of  the  literature  and  advance  the  state 
of  the  art.  This  group  includes  both  physicians 
and  economists,  and  several  of  the  recent  exem- 
plary studies  have  resulted  from  multidisci- 
plinary  collaboration  (e.g.,  472,575). 

Two  contextual  aspects  of  the  evaluation  pre- 
sented in  this  chapter  warrant  emphasis  at  the 
outset.  First,  many  of  the  limitations  of  health 


care  CEA/CBAs  are  endemic  to — and,  more  im- 
portantly, inherent  in — almost  all  CEA/CBAs. 
For  example,  the  inability  of  most  health  care 
CEA/CBAs  to  incorporate  distributional  con- 
siderations (177,179)  is  shared  by  CEA/CBAs 
on  education,  defense,  energy,  transportation, 
and  so  on.  This  chapter  attempts  to  identify  ge- 
neric CEA/CBA  problems  and  to  distinguish 
them  from  problems  that  are  specific  to  the 
health  care  literature.  The  chapter  also  distin- 
guishes problems  that  are  resolvable  from  those 
that  are  inherent  in  the  process  of  analysis. 

Second,  literature  reviews  often  restrict  their 
attention  to  the  most  prominent  articles  and 
books  in  the  literature,  as  is  the  case  in  the 
earlier  reviews  of  health  care  CEA/CBA  iden- 
tified in  appendix  A.  There  is  a  logic  to  this 
approach:  These  publications  reflect  and  indeed 
create  the  state  of  the  art;  because  they  are 
widely  read,  they  have  an  influence  on  profes- 
sional thinking  and  on  future  contributions  to 
the  literature  disproportionate  to  their  numbers. 
Nevertheless,  such  publications  constitute  only 
the  most  visible  portion  of  the  literature.  The 
10,  20,  or  30  articles  repeatedly  cited  in  health 
care  CEA/CBA  reviews  represent  considerably 
less  than  a  tenth  of  the  publications  that  can  be 
readily  identified  as  part  of  this  literature,  often 
by  explicit  inclusion  of  the  words  "cost-benefit" 
or  "cost-effectiveness"  in  their  titles.  A  few  such 
publications  are  clearly  mislabeled;  many  others 
are  on  the  right  track  but  are  so  "poorly"  han- 
dled that  a  CEA/CBA  purist  might  exclude 
them  from  a  CEA/CBA  bibliography.  Even 
though  the  less  well-known  publications  have  a 
readership  and  general  influence  far  smaller 
than  that  of  the  more  prominent  contributions, 
however,  they  may  constitute  the  principal  ex- 
posure of  many  practicing  health  professionals 
to  the  language,  concepts,  and  applications  of 
CEA/CBA. 

In  order  to  capture  the  essence  of  what  CEA/ 
CBA  means  to  health  professionals,  it  is  impor- 
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tant  to  critique  the  entirety  of  the  literature. 
Thus,  this  review  represents  an  attempt  to  inte- 
grate typical-practice  and  state  of  the  art  fea- 
tures of  the  literature.  The  basis  of  the  review  is 
an  assessment  of  general  tendencies  in  the  litera- 
ture as  a  whole,  including  the  90  percent  that  to 
a  large  extent  has  escaped  attention  in  previous 
reviews.  Common  problems  and  deficiencies  are 
frequently  counterbalanced  by  reference  to  suc- 


cessful attempts  to  address  the  deficiencies. 
Thus,  while  this  review  adopts  a  generally  criti- 
cal stance  toward  the  literature,  it  acknowledges 
the  many  examples  of  technical  proficiency  in 
the  practice  of  health  care  CEA/CBA.  For  a  re- 
view that  concentrates  on  the  high-quality  end 
of  the  spectrum,  the  reader  is  referred  to  the  re- 
cent paper  by  Weinstein  (569). 


METHODLOLOGY  AND  REVIEW  ARTICLES:  CONVEYING 
PRINCIPLES  AND  PRACTICE  TO  THE  HEALTH  CARE  COMMUNITY 


All  good  studies  inform  readers  about  CEA/ 
CBA  methods,  either  implicitly  through  its  ap- 
plication (e.g.,  122)  or  explicitly  through  discus- 
sion of  methodological  issues  (e.g.,  148).  Recent 
books  have  served  several  functions:  attempting 
to  convey  basic  principles,  break  new  methodo- 
logical ground,  and  demonstrate  the  utility  of 
CEA/CBA  through  specific  applications  (73, 
516).  Over  the  years,  however,  there  has  been 
only  a  handful  of  articles  written  solely  to  pre- 
sent or  to  evaluate  the  state  of  the  art  in  health 
care  CEA/CBA. 

During  the  period  studied  (1966-78),  the  first 
two  such  articles  were  published  in  the  first  2 
years  of  the  period.  In  1966,  Crystal  and  Brew- 
ster (722)  wrote  an  introduction  to  CEA/CBA  in 
the  health  field.  In  1967,  Klarman  published  the 
first  of  two  prominent  reviews  he  has  written, 
this  one  appearing  in  the  American  Journal  of 
Public  Health  (295).  From  then  until  1972,  no 
significant  health  care  review  or  methodology 
contributions  appeared  in  print,  with  the  excep- 
tion of  a  chapter  by  Grosse  (241)  in  a  book  ori- 
ented toward  students  of  economics  and  policy 
analysis.  That  chapter  is  particularly  note- 
worthy for  its  review  of  CEA/CBA  applications 
in  the  Department  of  Health,  Education,  and 
Welfare  (HEW)  during  the  author's  tenure  as  an 
HEW  official.  Grosse  conveyed  much  of  the 
same  material  2  years  later  in  an  article  pub- 
lished in  1972  (240),  though  again  the  audience 
was  not  specifically  health  care  professionals. 

That  same  year,  however,  witnessed  publica- 
tion of  a  book  that  has  become  one  of  the  health 


care  community's  most  widely  read  and  fre- 
quently cited  contributions,  Cochrane's  Effec- 
tiveness and  Efficiency:  Random  Reflections  on 
Health  Services  (97).  This  short  book  appears  to 
have  had  a  profound  and  sustained  impact  in 
turning  the  thoughts  of  health  care  professionals 
toward  issues  of  resource  scarcity  and  the  link 
between  efficiency  and  equity.  It  is  at  least 
possible  that  Cochrane's  book  played  a  signifi- 
cant role  in  the  rapid  growth  in  health  care 
CEA/CBA  that  began  in  1973. 

The  most  often-cited  review  and  discussion  of 
health  care  CEA/CBA  is  Klarman's  second  arti- 
cle (291),  which  appeared  in  1974.  The  follow- 
ing year,  Dunlop  (153)  published  a  review  that 
characterized  the  early  literature,  thus  provid- 
ing some  interesting  contrasts  with  current 
CEA/CBA  practice.  In  1975,  the  major  portion 
of  an  issue  of  the  New  England  Journal  of  Medi- 
cine (NEJM)  was  devoted  to  a  discussion  of 
CEA/CBA  methodology  and  to  several  illustra- 
tions of  its  application.  To  many  observers,  this 
NEJM  issue  stands  as  a  landmark  in  the  evalua- 
tion of  medical  practice.  It  should  be  noted  that 
none  of  the  previous  reviews  had  been  published 
in  a  medical  journal. 

Two  years  later,  another  issue  of  NEJM  of- 
fered readers  a  package  of  two  articles  and  an 
editorial,  including  a  discussion  of  CEA  meth- 
odology (574),  a  sophisticated  application  of  it 
(516),  and  an  important,  thoughtful  treatment 
of  the  limitations  of  formal  analysis,  including 
the  potential  for  a  "tyranny  of  numbers"  and 
associated  disregard  of  equity  considerations 
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(177).  Many  health  services  researchers  consider 
this  package,  combined  with  Weinstein  and  Sta- 
son's  book  (575),  to  be  a  milestone  in  health  care 
CEA/CBA. 

A  recent  review  was  presented  at  an  Urban 
Institute  Conference  on  Medical  Technology  in 
December  1978  (569).  This  paper  offered  a  state- 
of-the-art  assessment  of  the  literature  and  a 
review  of  "a  nonrandom  sample"  of  health  care 
CEA/CBAs.  The  most  noteworthy  feature  of 


the  paper  is  the  author's  discussion  of  remaining 
methodological  issues.  Although  several  of  the 
issues  have  been  of  concern  since  the  inception 
of  formal  CEA/CBA,  others  represent  subtle, 
sophisticated  problems,  the  existence  of  which  is 
testimony  to  progress  on  more  basic  issues.  In- 
deed, the  paper  serves  as  a  vivid  reminder  si- 
multaneously of  the  frustrating,  seemingly  in- 
tractable problems  of  CEA/CBA,  and  of  the 
gradual  yielding  of  some  of  them  to  sustained 
conceptual  and  empirical  struggle. 


DEFINING  THE  PROBLEM,  OBJECTIVES,  AND  ALTERNATIVES 


In  a  review  of  the  early  health  care  CBA  liter- 
ature, Dunlop  (153)  concluded  that  the  most 
common  use  of  CBA  had  been  to  analyze  dis- 
ease-specific programs  of  intervention.  By  be- 
ginning with  disease  problems,  several  early 
analyses  had  the  opportunity  to  explore  a  wide 
range  of  alternative  interventions.  For  example, 
the  interest  of  LeSourd,  et  al.  (327)  in  identify- 
ing efficient  means  of  grappling  with  kidney  dis- 
ease led  these  investigators  to  compare  the  costs 
and  benefits  of  a  variety  of  programs  ranging 
from  prevention  of  disease  to  treatment  of  renal 
failure.  Similarly,  Acton  (4)  employed  both 
CBA  and  CEA  to  examine  several  alternative 
prehospital  programs  for  reducing  deaths  due  to 
myocardial  infarction.  Even  in  studies  of  nar- 
rower problems — for  example,  the  treatment  of 
existing  disease — comparison  of  alternatives 
characterized  much  of  the  early  analyses.  Thus, 
the  focus  of  Klarman,  et  al.  (298)  on  kidney  dis- 
ease treatment  precluded  consideration  of 
prevention  alternatives,  but  the  authors  exam- 
ined all  of  the  major  therapeutic  alternatives. 

Most  of  the  contributions  to  the  early  liter- 
ature shared  a  focus  on  a  problem  and  specific 
objectives  that  had  a  distinct  health  (or  disease) 
starting  point.  At  the  extreme,  HEW  analysts 
used  CEA  and  CBA  to  examine  resource  alloca- 
tion across  a  wide  variety  of  disease  and  acci- 
dent control  programs  (240,241).  More  narrow 
problem  definitions  implied  fewer  and  less  dis- 
parate alternatives,  but  the  health  relevance  of 
the  objective  was  generally  clear.  Thus  Weis- 
brod's  (577)  examination  of  the  costs  and  bene- 


fits of  medical  research  was  restricted  to  the  case 
of  polio,  but  the  analysis  centered  on  the  health 
consequences  of  polio  research  and  consequent 
prevention  of  the  disease. 

In  recent  years,  there  have  been  numerous  at- 
tempts to  use  CEA/CBA  to  analyze  programs 
having  clear  health  relevance  (e.g.,  122,472, 
473,573),  but  two  factors  seem  to  be  increasing 
the  proportion  of  studies  whose  health  relevance 
is  implicit,  tangential,  or  simply  unclear.  The 
first  is  a  tendency  to  assume  that  certain  pro- 
grammatic outcomes  are  desirable,  without 
questioning  their  ultimate  health  implications. 
Common  examples  are  studies  that  conclude 
that  certain  screening  efforts  are  "cost  effective" 
because  they  are  inexpensive,  but  that  lack  any 
exploration  of  the  costs  and  health  effectiveness 
of  followup  of  the  cases  found  (133).  The  second 
is  a  technical  factor  and  reflects  the  current  im- 
portance of  cost  containment  as  a  health  policy 
issue.  Much  analysis  has  moved  from  a  focus  on 
promoting  health  toward  concern  with  achiev- 
ing efficiency  in  the  provision  of  existing  health 
services,  including  particularly  a  group  of  inter- 
mediate medical  services  whose  ultimate  health 
impact  cannot  be  discerned.  In  this  case,  the 
question  becomes  how  to  provide  a  medically 
accepted  service  most  efficiently,  without  being 
able  to  evaluate  definitively  (if  at  all)  its  health 
implications. 

Illustrative  of  this  phenomenon  is  the  CEA/ 
CBA  literature  on  computed  tomography  (CT) 
scanning,  the  single  most  studied  technology  of 
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the  last  2  years  examined  in  OTA's  bibliograph- 
ic search  (1977-78).  As  observed  in  chapter  1, 
the  CT  scanner  is  the  only  expensive,  equip- 
ment-embodied technology  to  have  been  the 
subject  of  considerable  CEA/CBA  attention, 
but  it  may  be  in  the  vanguard  in  this  respect, 
rather  than  being  an  exception.  Furthermore, 
the  CT  scanner  exemplifies  the  difficulties  in- 
volved in  evaluating  diagnostic  procedures 
(360,558,559),  an  area  that  has  been  identified 
as  deserving  of  much  greater  CEA/CBA  effort 
(569).  Despite  sharing  the  same  technology— the 
scanner — as  a  starting  point,  the  authors  of  the 
numerous  CEA/CBAs  diverge  significantly  in 
their  perceptions  of  the  objectives  of  scanning 
and  hence  in  their  evaluations  of  its  cost  effec- 
tiveness. At  one  extreme,  the  diagnostic  effec- 
tiveness of  scanning  is  assumed,  with  no  at- 
tempt to  link  diagnosis  to  either  patient  manage- 
ment or  outcome;  cost  effectiveness  is  measured 
as  the  cost  savings  from  using  the  CT  scanner, 
as  opposed  to  alternative  techniques,  to  perform 
a  given  volume  of  diagnoses  (211).  At  the  other 
extreme,  effectiveness  is  defined  in  terms  of  ef- 
fects in  disease  management  and  patient  out- 
come (28).  The  latter  seems  the  socially  most 
desirable  concept  of  effectiveness,  but  the  prob- 
lems in  its  determination  are  substantial,  and  it 
misses  additional  benefits  such  as  those  associ- 
ated with  decreasing  patients'  uncertainty,  di- 
recting short-term  patient  management,  and 
contributing  to  greater  medical  understanding 
(2,32).  Needless  to  say,  the  differing  objectives 
result  in  widely  varying  assessments  of  the  de- 
sirability of  scanning. 

Determining  objectives  for  purposes  of  analy- 
sis is  frequently  regarded  as  a  trivial  exercise, 
but  examples  from  the  literature  illustrate  that  it 
may  require  considerable  thought  and  that  the 
absence  of  such  effort  can  damage  the  quality  of 
analysis.  A  failure  to  appreciate  the  limits  of  a 
selected  objective  can  mislead  both  analyst  and 
decisionmaker.  For  example,  when  HEW  ana- 
lysts decided  to  compare  the  cost  effectiveness 
of  alternative  disease  control  programs,  they  se- 
lected lives  saved  as  the  measure  of  effective- 
ness. This  variable  (and  variants  on  it,  such  as 
life-years  or  quality-adjusted  life  years  (QALYs) 
saved)  is  a  common  measure  of  health  impact  in 
CEAs,  but  it  is  not  a  comprehensive  one.  HEW 


analysts  recognized  this  by  observing  that  an  ar- 
thritis control  program  could  never  be  justified 
on  the  basis  of  lives  saved,  but  that  the  program 
ranked  as  one  of  the  better  investments  when 
the  benefits  associated  with  disability  avoided 
were  taken  into  account  in  a  CBA  framework 
(240).  Fairly  few  health  care  CEAs  make  explicit 
reference  to  the  nature  of  the  biases  their  effec- 
tiveness measures  introduce.  It  may  be  that 
many  such  biases  have  not  even  occurred  to  the 
analysts. 

Fein  (177)  has  noted  the  tendency  of  health 
care  CEA/CBAs  to  "relegate  to  a  footnote"  a 
variety  of  nonquantifiable  benefits  (e.g.,  caring, 
or  reduction  of  pain).  With  a  reference  to  both 
intangible  benefits  and  distributional  effects  that 
cannot  be  valued,  he  noted  that  as  "the  numbers 
gain  currency  ...  a  'climate  of  opinion'  is  cre- 
ated: that  which  is  measured  is  important  and 
vice  versa."  This  problem  is  common  to  analysis 
in  virtually  all  areas,  though  its  importance  is 
probably  greatest  in  the  social  welfare  fields 
such  as  health,  education,  and  justice.  In  some 
cases,  though,  benefits  that  are  difficult  to  quan- 
tify or  value  have  escaped  even  footnoting.  For 
example,  in  an  otherwise  sophisticated  CEA 
comparing  hysterectomy  and  tubal  ligation  as 
sterilization  alternatives,  Deane  and  Ulene  (134) 
ignored  the  preferences  of  the  women  involved. 
The  authors  carefully  analyzed  the  direct  costs 
of  the  procedures  and  indirect  costs  of  complica- 
tions and  later  disease,  but  the  emotional  reac- 
tions and  feelings  that  might  be  expected  to 
dominate  many  women's  decisions  received  no 
consideration  in  their  analysis.  Problems  of 
measuring  and  valuing  intangible  benefits  per- 
vade the  health  care  CEA/CBA  literature.  They 
are  exacerbated  by  the  failure  of  many  analysts 
to  identify  such  benefits  in  specifying  objectives. 

In  recent  years,  there  appears  to  have  been  a 
narrowing  of  problem  definition  in  health  care 
CEA/CBA.  Accompanying  this  has  been  a  re- 
duction in  the  number  and  scope  of  alternatives 
examined  through  CEA/CBAs.  The  extreme — 
an  analysis  of  a  single  program  or  procedure, 
with  the  only  "alternative"  being  its  absence — 
has  become  reasonably  common  in  the  litera- 
ture. Another  development,  exemplified  by  the 
analyses  of  Eddy  (157,158)  and  Schoenbaum,  et 
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al.  (472,473),  represents  an  intermediate  posi- 
tion between  a  single-program  analysis  and  a 
comparison  of  numerous  qualitatively  diverse 
alternatives:  Several  analysts  are  using  mathe- 
matical techniques  to  design  or  determine  the 
optimal  (i.e.,  most  cost-effective)  structure  of  a 
program  by  analyzing  the  effects  of  changes  in 
several  parameters  and  assumptions  (e.g.,  com- 


pliance rates,  diagnostic  accuracy,  therapeutic 
effectiveness).  In  essence,  such  analysts  are  ex- 
amining a  large  number  of  "programs"  of  a  sin- 
gle type.  Even  though  confining  analysis  to  a 
single  program  type  implies  limitations,  this  ap- 
proach holds  the  promise  of  making  significant 
contributions  to  policy  understanding  and  pro- 
gram development. 


ASSESSING  PRODUCTION  RELATIONSHIPS 


Technical  aspects  of  analysis  clearly  differen- 
tiate high-quality  analyses  from  the  more  typi- 
cal contributions.  Nowhere  is  this  more  evident 
than  in  the  modeling  of  production  relation- 
ships. A  summary  characterization  of  the  differ- 
ence is  this:  The  better  studies  carefully  consider 
and  address  production  issues,  whereas  the  typi- 
cal contributions  adopt  a  "black  box"  approach 
to  production  (that  is,  they  observe  existing  pro- 
grams' inputs  and  outputs  and  ignore  current  in- 
efficiencies and  predictable  future  changes). 

In  part,  this  difference  is  legitimate,  reflecting 
the  diverse  purposes  of  analyses.  Many  of  the 
better  studies  have  a  prospective,  or  planning, 
intent.  The  studies  are  oriented  toward  predict- 
ing the  costs  and  benefits  or  effectiveness  of 
alternative  future  programs,  so  the  analysts 
model  idealized  versions  of  these  future  pro- 
grams, recognizing  significant  variations  from 
current  similar  programs  when  such  exist  (e.g., 
scale,  efficiency,  relative  costs,  technological 
change).  By  contrast,  many  of  the  more  typical 
analyses  have  a  retrospective  or  evaluative  pur- 
pose. In  these  the  analysts  wish  to  assess  the  per- 
formance of  a  program  in  terms  of  its  realized 
costs  and  outcomes.  Even  for  this  type  of  assess- 
ment, however,  it  is  usually  important  to  exam- 
ine the  black  box  of  production  so  as  not  to  at- 
tribute to  inputs  outcomes  that  occur  by  chance. 

When  the  purpose  is  retrospective  evaluation, 
the  identification  and  measurement  of  experi- 
enced inputs  and  outcomes  are  appropriate. 
Often,  however,  it  appears  that  authors  who 
have  a  prospective  planning  objective  in  mind 
have  not  thought  through  the  limitations  of  ex 
post  evaluation.  Implicit  in  their  analyses  is  the 
assumption  that  existing  programs  are  accurate 


models  of  the  alternative  futures.  Occasionally 
this  may  be  reasonable,  but  the  assumption  is 
fraught  with  hazards.  Common  errors  in  the  lit- 
erature include: 

•  failure  to  account  for  scale  effects,  i.e.,  tak- 
ing an  existing  program  (e.g.,  a  worksite 
hypertension  screening  and  treatment  pro- 
gram) and  assuming  that  a  national  pro- 
gram intended  to  serve  (say)  1,000  times  as 
many  people  will  require  1,000  times  as 
many  inputs  (i.e.,  costs)  and  produce  1,000 
times  the  output; 

•  failure  to  consider  how  environmental  fac- 
tors might  alter  program  inputs  and  out- 
comes (e.g.,  assuming  that  the  production 
function  for  an  urban  worksite  hyperten- 
sion screening  and  treatment  program 
would  serve  as  a  valid  model  for  planning  a 
nationwide  screening  and  treatment  effort 
both  inside  and  outside  of  work  settings); 

•  ignoring  predictable  technical  changes  over 
time  (e.g.,  assessing  the  "future"  of  CT 
scanning,  assuming  that  the  technology — 
and  hence  inputs  and  outcomes — will  not 
change  from  what  exists  at  present); 

•  ignoring  predictable  increases  over  time  in 
the  efficiency  of  operation  of  a  technology 
or  program,  i.e.,  the  "learning  curve"  phe- 
nomenon (e.g.,  assuming  that  the  perform- 
ance of  program  personnel  will  not  im- 
prove over  time  as  they  gain  familiarity 
and  experience); 

•  ignoring  likely  shifts  in  the  relative  costs  of 
inputs  (e.g.,  the  price — wage  rate — of  labor 
rising  more  rapidly  than  the  price  of  equip- 
ment) and  consequent  changes  in  the  mix  of 
inputs  used; 
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•  failing  to  identify  avoidable  inefficiencies  in 
the  existing  "model"  program  and  thus  in- 
puting  them  to  the  structure  and  operation 
of  future  programs;  such  inefficiencies 
could  reflect  an  inefficient  input  mix  (e.g., 
having  a  high-priced  technician  perform  a 
function  which  could  be  automated  inex- 
pensively) or  an  inappropriate  use  of  tech- 
nology (e.g.,  condemning  CT  scanning  as 
exorbitantly  expensive  because  it  is  used  in- 
discriminately, rather  than  limiting  uses  to 
those  which  are  medically  and  economical- 
ly justifiable);  and 

•  conversely,  failing  to  anticipate  that  both 
the  inputs  and  outcomes  of  a  carefully 
monitored  program  in  a  major  medical  cen- 
ter may  not  be  replicated  as  the  program 
diffuses  into  general  practice. 

Most  of  these  deficiencies  of  ex  post  evalua- 
tion for  prospective  planning  become  more  se- 
vere the  more  novel  the  technology  or  program 
in  question.  A  familiar,  established,  and  suc- 
cessful program  is  more  likely  to  represent  a 
good  model  for  planning  purposes  than  is  a 
new,  or,  especially,  an  experimental  program. 
Yet  a  major  role  of  a  forward-looking  CEA/ 
CBA  ought  to  be  to  assess  the  potential  costs 
and  benefits  (effectiveness)  of  a  program  before 
it  has  diffused  throughout  the  medical  system. 

CT  serves  as  an  excellent  example  of  the  great 
difficulties  of  undertaking  useful  analysis  early 
to  influence  planning  and  decisionmaking. 
These  difficulties  span  the  spectrum  of  applica- 
tions of  CEA/CBA,  but  they  are  particularly  se- 
vere in  an  area  such  as  medicine  in  which  tech- 
nological change  occurs  rapidly  and  frequently. 
It  was  exceedingly  difficult  to  perform  an  ade- 
quate analysis  of  CT  scanning  prior  to  its  diffu- 
sion. Yet  all  of  the  studies  in  the  literature  relied 
on  that  early  experience  for  data,  and  most  of 
the  early  studies  failed  to  anticipate  changes  that 
have  already  occurred,  only  a  few  years  follow- 
ing publication  of  the  studies.  Furthermore,  an- 
ticipated changes  in  radiological  technology 
may  make  CT  scanning  technically  obsolete 
within  a  few  years,  yet  the  nature  and  amount 
of  relevant  information  are  not  adequate  to  in- 
corporate this  factor  into  an  analysis  intended 


to  assist  planning.  The  CEA/CBA  literature  on 
the  CT  scanner  does  not  address  this  issue. 

Formal  modeling  is  difficult,  a  simple  fact  that 
may  account  for  the  lack  in  much  of  the  litera- 
ture of  imaginative,  useful  characterization  of 
production  relationships.  At  a  minimum,  mod- 
eling requires  talent  in  disciplined  concep- 
tualization; frequently,  it  also  necessitates  ap- 
plication of  specific  mathematical  or  formal 
modeling  skills.  The  latter,  in  particular,  are  not 
available  in  abundant  supply.  Medical  educa- 
tion generally  includes  no  consideration  of  such 
skills,  and  few  analysts  with  appropriate  train- 
ing from  other  disciplinary  backgrounds  have 
devoted  their  attention  to  health  care  CEA/CBA 
issues.  There  are,  of  course,  notable  exceptions. 
By  example,  through  methodological  contribu- 
tions, and  by  direct  discussion  of  issues,  numer- 
ous authors  improve  both  the  current  and  future 
state  of  the  art  of  assessing  production  relation- 
ships. Review  articles  have  communicated  basic 
principles,  improving  the  critical  abilities  of 
readers  and,  one  would  hope  authors  of  future 
studies.  Specific  CEA/CBAs  in  the  literature 
have  illustrated  skillful  conceptualization,  use 
of  mathematics,  and  formal  modeling  tech- 
niques (e.g.,  22,122,134,157,159,479,480,516). 

Mathematics  and  formal  modeling  can  intimi- 
date, impress,  and  confuse  the  uninitiated.  In 
order  to  put  the  formalism  into  proper  perspec- 
tive, it  is  imperative  that  authors  clarify  the  im- 
plications of  both  explicit  and  implicit  assump- 
tions in  the  modeling  and  emphasize  the  limita- 
tions of  their  studies.  There  is  a  significant  risk 
that  the  uninitiated  will  be  overly  impressed 
with  formalism,  so  the  caveats  should  be  more 
than  simple  disclaimers.  Yet  only  a  minority  of 
health  care  CEA/CBAs  have  taken  this  require- 
ment seriously  (e.g.,  122,516). 

High-quality  analysis  of  production  relation- 
ships does  not  require  sophisticated  modeling 
efforts.  A  few  studies  have  exhibited  both  ele- 
gant conceptualization  and  structural  simplic- 
ity. For  example,  in  their  analysis  of  the  nation- 
al swine  flu  immunization  program,  Schoen- 
baum,  et  al.  (473)  considered  the  effects  of  vary- 
ing acceptance  rates,  probability  of  an  epidem- 
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ic,  and  other  factors  in  a  manner  that  was  tech- 
nically sound  and  readily  understandable.  Par- 
ticularly in  the  medical  literature,  which  is  read 
by  an  audience  that  generally  is  mathematically 


unsophisticated,  the  clarity  of  studies  such  as 
this  one  probably  serves  to  educate  and  to  build 
interest  in  well  thought  out  CEA/CBAs. 


IDENTIFYING,  MEASURING,  AND  VALUING 
BENEFITS/EFFECTIVENESS  AND  COSTS 


Benefits/Effectiveness 

A  central  concern  of  many  health  care  CEA/ 
CBAs,  both  conceptually  and  empirically,  is 
adequately  capturing  the  health  consequences  of 
programs.  Only  one  such  consequence  lends  it- 
self to  unassailable,  objective  measurement:  re- 
ductions in  mortality.  Another  common,  if  not 
universally  accepted,  measure  of  health  im- 
provement, however,  is  reduced  days  of  mor- 
bidity or  disability.  Neither  of  these  measures 
accounts  for  variations  in  the  quality  of  the  re- 
sulting days  of  less  impaired  health.  Analysts 
have  adopted  a  few  means  of  adjusting  for  this 
quality  factor,  but  to  date  there  has  been 
nothing  approaching  consensus  on  specific 
methods  of  adjustment. 

Analysts'  inability  to  quantify  satisfactorily 
certain  health  benefits  appears  to  be  the  primary 
reason  for  their  exclusion  from  formal  calcula- 
tions. A  second  reason  is  the  difficulty  of  identi- 
fying what  it  is  that  patients  seek  and  receive 
from  health  care.  As  noted  above,  comprehen- 
sive analyses  of  the  tangible  costs  and  benefits 
of  treatment  alternatives  have  sometimes  ig- 
nored the  emotional  or  psychological  motiva- 
tions that  may  lead  patients  to  prefer  one  treat- 
ment over  another,  as  if  the  patients  were  mere- 
ly inputs  into  a  physical  production  function 
(134).  In  other  words,  patients'  objectives  and 
values  are  not  limited  to  measurable  physical 
health  improvement,  and  if  patients'  objectives 
do  not  represent  social  concerns,  the  very 
reason  for  considering  a  health  program  is  chal- 
lenged.1 


1_rhere  are  instances  in  which  the  patients'  objectives  and  values 
may  be  considered  irrelevant,  or  at  least  secondary,  to  society's 
values.  Care  of  the  severely  mentally  ill  patient  represents  an  ex- 
treme example.  Externalities  and  paternalism  provide  more  com- 
mon justifications.  An  example  is  a  requirement  that  children  re- 
ceive certain  immunizations  prior  to  enrolling  in  school . 


Obviously,  the  significance  for  an  individual 
CEA/CBA  of  the  inability  to  quantify  certain 
benefits  depends  on  the  relative  importance  of 
those  benefits  in  the  program  under  considera- 
tion. Certain  health  problems  present  seemingly 
insurmountable  barriers  to  the  objective  meas- 
urement of  their  benefits,  yet  their  importance 
has  prompted  analysts  to  grapple  with  them  in  a 
CEA/CBA  framework.  Examples  include  men- 
tal retardation  (99),  mental  illness  (463),  and 
care  of  the  terminally  ill.  Without  succeeding  in 
quantifying  the  intangibles,  the  efforts  of 
analysts  to  deal  with  problems  such  as  these 
have  contributed  to  an  increased  understanding 
of  the  nature  of  the  problems  and  the  associated 
programs. 

For  many  health  programs,  the  principal 
health  benefits  are  the  more  tangible,  or  quan- 
tifiable, reductions  in  mortality,  morbidity,  and 
disability.  Nevertheless,  CEA/CBA  assessment 
of  benefits  (effectiveness)  is  far  from  problem 
free.  How  does  one  measure  and  value  benefits 
(effectiveness)  in  units  that  are  commensurable 
with  each  other  or  with  costs?  Days  of  morbidi- 
ty avoided,  for  example,  are  not  directly  com- 
parable to  days  of  mortality  avoided. 

In  the  health  care  CEA/CBA  literature,  there 
are  three  principal  approaches  to  this  problem: 
1)  accepting  it  as  an  unresolvable  problem,  and 
selecting  a  single  (presumably  dominant)  out- 
come as  the  index  of  benefit  or  effectiveness;  im- 
plicit in  this  approach  is  the  assumption,  or 
hope,  that  nonmeasured  benefits  vary  propor- 
tionately and  positively  with  the  single  outcome 
measure;  2)  employing  an  index  of  health  effects 
or  of  health  status;  and  3)  adopting  one  of  two 
methods  of  valuing  major  outcomes  in  mone- 
tary terms.  The  first  two  of  these  provide  effec- 
tiveness measures  for  CEAs,  while  the  third 
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yields  the  monetary  benefit  measurement 
needed  for  CBAs.  A  fourth  approach,  rarely 
found  in  the  literature,  would  be  to  not  force  an 
aggregation  of  effects  or  benefits.  A  possible 
"array"  method  is  discussed  in  chapter  4. 

The  first  approach — the  most  common  one  in 
the  literature — is  the  easiest  to  accomplish  and 
perhaps  to  understand.  It  is  also,  however,  the 
least  conceptually  appealing,  because  of  its  un- 
satisfactory (often  implicit)  assumption  that  de- 
creases in  mortality,  for  example,  correlate 
highly  with  decreases  in  such  factors  as  morbidi- 
ty, pain,  and  suffering.  A  prominent  example, 
noted  earlier,  comes  from  the  mid-1960's  HEW 
disease  control  program  analysis  in  which  "lives 
saved"  served  as  the  proxy  for  all  health  benefits 
in  the  CEA  comparison  of  programs.  As  the 
analysts  observed,  "lives  saved"  as  the  effec- 
tiveness measure  relegated  arthritis  to  the  bot- 
tom of  the  list  of  cost-effective  programs.  When 
the  programs  were  compared  by  means  of  cost- 
benefit  calculations,  however,  the  ability  to 
reduce  arthritis-related  morbidity  and  disability 
made  the  arthritis  control  program  appear  quite 
competitive  with  the  programs  that  saved  the 
most  lives  (240). 

The  single-measure  index  of  effectiveness  con- 
tinues to  dominate  health  care  CEAs,  but  modi- 
fications point  the  way  toward  more  refined 
measures  of  health  benefits.  "Lives  saved"  is  a 
gross  but  important  index  of  effectiveness  for 
many  health  programs.  "Life-years  saved"  adds 
an  element  of  quality  to  the  nature  of  deaths 
averted.2  This  measure  has  been  employed  in 
several  CEAs.  A  further  refinement  involves  ad- 
justing the  life-years  to  reflect  the  quality  of 
those  years.  Klarman,  et  al.  (298)  provided  an 
early  example  of  quality  adjustment  in  their 
CEA  study  of  alternative  renal  disease  treat- 
ments. They  argued  that  a  year  of  life  with  a 
well-functioning  transplanted  kidney  was  supe- 
rior to  a  year  of  life  on  dialysis — given  the  time, 
inconvenience,  and  discomfort  associated  with 
the  latter.  Consequently,  they  arbitrarily  valued 


2"Life-years  saved"  is  not  clearly  preferable  to  "lives  saved." 
Everyone  would  agree  that  more  years  saved  per  death  averted  is 
preferable  to  fewer  (other  things  being  equal);  but  is  10-years 
saved  for  one  person  preferable  to  4  years  saved  for  each  of  two 
people?  The  answer  is  inherently  subjective. 


a  year  of  life  on  dialysis  as  equal  to  0.75  year 
with  a  transplanted  kidney. 

The  idea  of  quality-adjusting  provided  the  ba- 
sis for  Weinstein  and  Stason's  (575)  use  of  an  in- 
dex of  health  effects  in  their  study  of  hyperten- 
sion screening  and  treatment  programs.  Their 
QALY  involves  adding  changes  in  life  expectan- 
cy to  changes  in  quality-adjusted  life  expectancy 
resulting  from  reduction  in  morbidity,  and  sub- 
tracting changes  in  quality-adjusted  life  expec- 
tancy due  to  iatrogenic  illness  and  treatment- 
induced  side  effects.  Selection  of  appropriate 
weights  remains  arbitrary  and  hence  a  problem. 
An  earlier  attempt  to  develop  a  health  status  in- 
dex produced  weights  (ranging  from  0  to  1)  that 
corresponded  to  a  spectrum  from  death  to  com- 
plete health  (726).  Despite  the  conceptual  appeal 
of  such  an  index,  the  inherent  weighting  prob- 
lems plus  the  so  far  inadequate  empirical  data 
base  have  led  to  very  limited  CEA/CBA  appli- 
cation of  this  type  of  index  (79). 

The  third  approach  to  valuing  benefits  in 
commensurable  units  is  to  translate  all  quan- 
tifiable outcomes  into  monetary  terms — benefit 
measurement  for  CBA.  A  common  approach, 
monetary  assessment  of  benefits  is  also  the  most 
controversial  approach  in  the  evaluation  of 
health  care  programs.  The  principal  issue,  as 
discussed  in  chapter  2,  is  the  valuation  of  hu- 
man life.  As  indicated  in  chapter  2,  the  human 
capital  approach  employs  a  market  measure  of 
the  value  of  life,  whereas  willingness-to-pay 
asks  how  people  value  their  own  lives,  subject 
to  their  ability  to  back  up  their  valuations  with 
economic  resources.  Willingness-to-pay  has 
considerable  conceptual  appeal,  but  to  date  no 
one  has  succeeded  in  developing  techniques  to 
produce  consistent  and  meaningful  estimates  of 
willingness-to-pay  (4).  The  human  capital  ap- 
proach has  its  own  conceptual  attributes,  but 
with  its  imputation  that  the  worth  of  a  life  is 
determined  solely  by  productivity,  it  has  fallen 
into  disfavor  among  many  practitioners  of 
health  care  CEA/CBA.  Since  the  human  capital 
approach  is  empirically  more  manageable  and 
consistent,  however,  the  vast  majority  of  CBAs 
have  employed  this  form  of  valuation.  This  is 
not  to  suggest,  however,  that  the  approach  in- 
variably has  been  applied  correctly.  Benefits 
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should  be  measured  as  the  costs  of  illness 
avoided.  Some  analysts  have  used  existing  cost- 
of-illness  estimates  as  direct  measures  of  bene- 
fit, without  recognizing  that  many  of  the  ill- 
nesses avoided  would  have  occurred  years  into 
the  future  and  hence  that  benefits  should  have 
been  discounted.  This  has  had  the  effect  of  in- 
flating benefit  estimates,  in  some  cases  consider- 
ably (309). 

In  any  given  study,  beyond  the  choice  of  a 
basic  approach  to  measuring  benefits  lies  deter- 
mination of  the  specific  measure(s).  In  CEAs, 
the  effectiveness  measure  is  often  reasonably 
obvious,  with  different  analysts  selecting  similar 
measures,  thereby  facilitating  cross-study  com- 
parisons. Treatment  of  kidney  failure  provides 
an  example  in  which  different  analysts  have  se- 
lected the  same  measure  of  effectiveness — life- 
years  saved — and  despite  a  difference  of  10 
years  in  publication  dates,  their  analyses  have 
produced  consistent  results  (298,513).  For  some 
topics,  however,  effectiveness  measures  are  less 
obvious,  with  the  result  that  different  investi- 
gators have  selected  qualitatively  distinctive 
measures  and  undertaken  analyses  that  pro- 
duced quite  different  and  not  directly  compara- 
ble results.  The  problem  seems  especially  rele- 
vant to  the  area  of  diagnosis  (360).  Its  presence 
in  the  literature  can  be  anticipated  to  grow  if 
analysis  of  diagnostic  procedures  increases,  as 
some  observers  believe  it  should  (569).  Resolu- 
tion of  the  problem,  if  possible,  may  lie  in  imag- 
inative efforts  to  translate  diagnostic  accuracy 
into  effects  on  patient  management  and  health 
outcome.  Among  the  CT  papers,  only  Baker 
and  Way's  (28)  attempted  to  do  this.  Their  scal- 
ing of  effects  involved  arbitrary  and  subjective 
judgments,  but  Baker  and  Way's  effort  stands 
out  as  one  of  the  few  published  attempts  to 
bridge  the  diagnosis-health  outcome  gap. 

The  literature  includes  few  examples  of  such 
efforts  to  grapple  with  challenging  assessment 
problems.  Nevertheless,  other  approaches  have 
been  adopted.  A  few  studies  identify  and  array 
noncomparable  measures  of  effects,  including 
rank-ordered  ones  (148).  The  argument  under- 
lying this  approach  is  that  if  effects  are  impor- 
tant but  cannot  be  measured  in  a  common  met- 
ric, decisionmakers  will  find  it  more  useful  and 


less  misleading  to  see  them  arrayed  in  an  "unfin- 
ished" CEA  (i.e.,  one  lacking  a  "bottom  line" 
cost-effectiveness  ratio)  than  to  have  one  or 
more  of  them  dropped  for  the  sake  of  calculat- 
ing a  "final"  cost-effectiveness  ratio.  Despite  its 
"incompleteness,"  the  CEA  by  Doherty,  et  al. 
(148),  for  example,  contributed  information  and 
structure  which  can  facilitate  understanding  of  a 
policy  issue. 

Consistent  definition  of  effectiveness  can  vary 
across  health  care  functions.  For  example,  men- 
tal retardation  illustrates  a  substantive  health 
problem  for  which  assessments  of  prevention  v. 
treatment  necessarily  involve  quite  different, 
noncomparable  measures  of  effectiveness.  Pre- 
vention of  retardation  (e.g.,  through  phenyl- 
ketonuria (PKU)  screening),  is  commonly  val- 
ued in  a  cost-benefit  framework  for  its  ability  to 
avoid  expenses  of  institutionalization  and  other 
care  by  preventing  the  birth  of  retarded  chil- 
dren; that  is,  the  benefits  of  the  program  are  fu- 
ture costs  avoided  (e.g.,  78,79,482).  By  con- 
trast, many  of  the  desired  effects  of  programs 
providing  care  for  an  existing  group  of  the  re- 
tarded are  less  tangible  and  less  economically 
oriented;  the  "costs  avoided"  metric  is  clearly 
inadequate  (99).  Obviously,  the  prevention- 
treatment  effectiveness  distinction  is  by  no 
means  universally  applicable.  Analysts  have 
successfully  relied  on  a  consistent  outcome 
measure  in  comparisons  of  prevention  and 
treatment  alternatives  for  kidney  disease  (327), 
myocardial  infarction  (4,122),  and  others. 

In  addition  to  addressing  all  of  the  problems 
noted  above,  analysts  must  identify  and  acquire 
data  needed  to  measure  benefits.  The  quality  of 
data  is  rarely  examined  carefully  in  health  care 
CEA/CBAs,  yet  it  is  a  common  constraining 
factor  across  most  studies.  Obviously,  assess- 
ment of  the  health  outcomes  of  a  variety  of  pro- 
cedures depends  on  the  availability  of  valid, 
reliable  experimental  or  epidemiological  data; 
such  data  do  not  always  exist,  and  even  when 
they  do,  they  are  not  always  accessible.  Benefit 
valuation  for  CBA  requires  in  addition  that  such 
data  be  translated  into  their  economic  implica- 
tions. The  methods  for  doing  this  are  conceptu- 
ally clear,  and  solid  empirical  assessment  of  the 
costs  of  illness  has  been  performed  (385,721, 
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747).  Nevertheless,  there  are  significant  varia- 
tions from  one  study  to  the  next,  implying  that 
use  of  differing  estimation  procedures  and  data 
could  compound  spurious  variations  in  benefit 
estimates  introduced  by  the  use  of  different 
health-outcome  data  sources.  The  issue  of  the 
reliability  and  validity  of  cost-of-illness  esti- 
mates is  currently  under  study  in  a  contract 
funded  by  the  National  Center  for  Health  Serv- 
ices Research.  The  National  Institutes  of  Health 
is  in  the  process  of  publishing  a  bibliography  of 
some  2,000  references  relating  to  cost-of-illness 
estimation. 

Data  for  several  health  care  CEA/CBAs  have 
relied  on  subjective  rankings,  surveys,  and  the 
like  (4,28,78,79).  The  issue  of  how  valid  and 
reliable  such  data  can  be  has  yet  to  be  resolved, 
though  several  studies  find  considerable  varia- 
tion depending  on  how  survey  questions  are 
phrased  (4,550).  Clearly,  conceptual  and  em- 
pirical work  on  benefit  assessment  measures  is  a 
pressing  need  in  health  care  CEA/CBA  (569). 

Analysts  in  the  United  States  have  access  to 
more  numerous  and  varied  data  sources  than  do 
investigators  in  many  other  countries.  Com- 
pared to  the  ideal,  however,  even  U.S.  data 
sources  exhibit  serious  deficiencies.  Many  sur- 
veys are  plagued  by  poor  methods,  producing 
unreliable  data  that  contribute  to  misleading 
analyses  (565,740).  The  national  data  collection 
effort  is  hindered  by  considerable  duplication  of 
effort  and  inconsistency  across  data  sets,  both 
resulting  in  part  from  a  lack  of  interagency 
coordination.3  The  development  of  better  orga- 
nized and  planned  basic  data  collection  is  essen- 
tial to  improving  the  quality  of  health  care 
CEA/CBA. 

Two  remaining  benefit  assessment  issues  are 
noted  here,  with  discussion  deferred  to  later  sec- 
tions. One  is  the  practice  of  discounting  bene- 
fits, occasionally  handled  well  in  the  literature, 
frequently  ignored.  The  other  is  analysts'  han- 
dling of  distributional  or  equity  concerns. 


3This  problem  is  discussed  in  some  detail  in  Selected  Topics  in 
Federal  Health  Statistics  (740),  a  report  prepared  by  OTA  in  June 
1979. 


Costs 

Apart  from  the  problems  of  measuring  and 
valuating  benefits/effectiveness,  the  literature 
reveals  numerous  examples  of  poor  or  inaccu- 
rate measurement  and  valuation  of  costs.  Defi- 
ciencies associated  with  cost  assessment  are  fre- 
quently more  insidious  than  those  associated 
with  benefit  assessment,  because  authors  com- 
monly devote  less  attraction  to  them.  Since  au- 
thors often  do  not  discuss  cost  analysis  prob- 
lems, they  fail  to  alert  readers  to  them;  further- 
more, the  analysts  themselves  in  many  cases 
seem  unaware  of  the  deficiencies  of  their  ap- 
proach, data  sources,  etc. 

Costs  are  a  reflection  of  resources  consumed. 
Thus,  many  of  the  difficulties  that  have  plagued 
cost  assessment  are  perfectly  analogous  to  those 
discussed  above  in  the  examination  of  analysts' 
handling  of  production  relationships.  Rather 
than  repeat  that  discussion,  this  section  simply 
notes  several  common  problems:  1)  often  ana- 
lysts have  measured  realized  (ex  post)  costs  in 
an  analysis  intended  for  prospective  planning 
without  allowing  for  learning,  technical,  and 
economic  changes  which  seem  likely  to  occur; 
2)  they  have  failed  to  distinguish  the  cost  im- 
plications of  running  programs  under  optimal  v. 
average  conditions;  3)  they  have  not  always  ac- 
counted for  the  differential  valuation  of  costs 
occurring  at  different  points  of  time  (the  dis- 
counting problem,  discussed  in  the  next  sec- 
tion). 

Just  as  there  are  problems  unique  to  benefit 
assessment  (e.g.,  valuation  of  lives  saved),  cer- 
tain problems  hinder  cost  analysis  in  particular. 
Chief  among  these  in  the  health  care  literature  is 
the  use  of  inaccurate  or  inadequate  proxies  for 
true  costs — a  significant  problem  because  of  its 
pervasiveness  and,  evidently,  the  failure  of 
many  investigators  even  to  be  aware  of  it.  A 
major  source  of  inaccuracy  is  the  use  of  market 
prices  as  measures  of  costs.  The  assumption  that 
prices  closely  mirror  true  costs  seems  reasonable 
in  some  smoothly  functioning  markets,  but 
market  imperfections  can  distort  the  relation- 
ship between  input  prices  and  their  true  oppor- 
tunity costs.  This  common  problem  reaches  its 
extreme — and  hence  introduces  the  most  signifi- 
cant distortions — in  cost  assessment  in  health 
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care  programs,  particularly  those  associated 
with  hospitals.  In  health  care  CEA/CBAs,  the 
use  of  prices  in  lieu  of  true  opportunity  costs 
generally  means  adoption  of  published  charges 
(e.g.,  from  hospital  billings  or  insurance 
charges)  as  the  index  of  cost.  Although  occa- 
sionally analysts  recognize  that  charges  may  not 
accurately  mirror  costs,  very  often  the  problem 
is  not  even  acknowledged  (92).  The  vast  majori- 
ty of  health  care  CEA/CBAs  employ  charges 
uncritically,  frequently  introducing  potentially 
large  errors  in  the  estimation  of  the  true  costs  of 
the  programs  in  question.  At  a  minimum,  ana- 
lysts ought  to  explore  the  relationships  between 
charges  and  actual  market  costs. 

Inadequate  cost  assessment  often  results  from 
failure  to  take  into  account  costs  which  are  real 
but  hidden.  For  example,  very  few  health  care 
CEA/CBAs  account  explicitly  for  the  costs  of 
patients'  time  traveling  to  medical  facilities  and 
waiting  for  and  receiving  services.  CBAs  occa- 
sionally capture  some  of  this  by  valuing  lost 
productivity,  but,  most  commonly,  lost  produc- 
tivity measurement  relates  only  to  days  of  mor- 
bidity, disability,  or  mortality  avoided,  and  not 
to  hours  involved  in  seeking  and  receiving  care; 
and  lost  productivity  is  not  the  only  time  cost 
associated  with  health  care  services.4  This  prob- 
lem is  exacerbated,  however,  by  the  fact  that 
many  employees  are  covered  (e.g.,  through  sick 
leave)  for  time  off  from  work  for  medical  visits. 
Thus,  neither  the  physician  nor  the  patient  per- 
ceives the  time  as  "lost,"  and  analysts  sensitive 
to  the  time-cost  issues  might  overlook  the  fact 
that  the  time  imposes  real  costs  on  society  (e.g., 
physical  productivity  lost). 


4That  people  value  such  lost  time  is  demonstrated  by  the  willing- 
ness of  many  individuals  to  accept  significant  charges  from  private 
physicians  in  lieu  of  waiting  a  long  time  in  lower  cost  medical  clin- 
ics. The  waiting-time  mechanism  of  rationing  medical  services  is 
highly  inefficient  socially,  producing  a  "deadweight  loss,"  that  is, 
patients  lose  their  free  time,  and  no  one  gains  directly  from  that 
loss. 


A  second  example  of  real  costs  that  have 
escaped  attention  in  health  care  CEA/CBAs  is 
the  value  of  volunteers'  time  mentioned  in  chap- 
ter 2. 

An  unresolved  cost  assessment  issue  is  wheth- 
er analysts  ought  to  assume  efficiency  in  pro- 
gram operation  or  build  in  "slack"  for  likely  in- 
efficiencies. The  former  is  appropriate  for  eval- 
uating the  ideal,  but  the  latter  seems  more  likely 
to  reflect  what  will  come  to  pass  should  the  pro- 
gram be  implemented.  This  issue  has  received 
virtually  no  attention  in  the  empirical  litera- 
ture. Common  practice  has  been  to  measure  re- 
sources used  in  programs,  rather  than  to  iden- 
tify efficient  resource  use,  but  only  a  few  studies 
suggest  that  the  investigators  have  even  contem- 
plated the  difference. 

A  technical  cost  issue  of  considerable  impor- 
tance derives  directly  from  the  discussion  in  an 
earlier  section  of  the  relative  lack  of  attempts  by 
analysts  to  distinguish  marginal  from  average 
resource  consumption.  Most  commonly,  au- 
thors have  used  average  total  costs  of  existing 
programs  to  predict  the  costs  of  program  expan- 
sion, modification,  etc.  When  capital  costs  are 
substantial  or  marginal  costs  vary  significantly, 
failure  to  distinguish  marginal  from  average 
costs  can  produce,  and  often  has  produced,  mis- 
leading cost  estimates.  Although  some  analysts 
have  demonstrated  sensitivity  to  the  distinction, 
direct  extrapolation  from  average  costs  domi- 
nates the  health  care  CEA/CBA  literature. 

As  in  the  case  of  benefit  measurement,  data 
availability  and  quality  problems  hinder  effec- 
tive cost  analysis.  For  example,  data  on  charges 
are  relatively  accessible,  but  many  cost  data  (in 
particular,  data  needed  to  reflect  opportunity 
costs)  are  not.  The  current  interest  in  cost  con- 
tainment has  promoted  governmental  efforts  to 
acquire  more  and  better  cost  information,  but 
the  acquisition  and  appropriate  use  of  cost  data 
will  linger  as  a  major  problem  in  CEA/CBA  for 
years  to  come. 
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VALUING  BENEFITS  AND  COSTS  OVER  TIME:  DISCOUNTING 


The  discounting  of  benefits  and  costs  realized 
over  time  is  one  of  the  most  technical  features  of 
CEA/CBA.  It  is  also  one  of  the  principal  sources 
of  analytical  weakness  in  the  health  care  litera- 
ture. Owing  to  the  potentially  profound  influ- 
ence of  discounting  on  valuation  of  costs  and 
benefits  (effectiveness),  the  absence  of  discount- 
ing in  numerous  health  care  analyses  severely 
discredits  those  analyses.  In  addition,  the  failure 
of  some  investigators  to  test  the  sensitivity  of 
their  findings  to  the  value  of  the  discount  rate 
raises  questions  about  the  robustness  of  those 
findings.  (Sensitivity  analysis  is  discussed  in  the 
next  section  of  this  chapter.) 

The  literature  is  replete  with  examples  of  the 
total  absence  of  discounting.  In  the  studies  that 
have  employed  discounting,  the  basic  method  is 
generally  sound;  that  is,  discounting  has  been 
done  either  technically  well  or  not  at  all.  How- 
ever, only  a  minority  of  the  studies  that  have 
used  discounting  have  included  examination  of 
the  effects  of  the  value  of  the  discount  rate  on 
the  bottom  line  regarding  net  benefits  or  cost  ef- 
fectiveness. Yet,  as  several  of  these  studies  dem- 
onstrate, when  significant  realization  of  costs  or 
benefits  occurs  well  into  the  future,  the  discount 
rate  selected  and  the  method  of  discounting  can 
play  pivotal  roles  in  determination  of  a  pro- 
gram's value  (513,572).  For  example,  in  her 
study  comparing  programs  to  treat  or  prevent 
myocardial  infarction,  Cretin  (122)  tested  the 
sensitivity  of  her  cost-effectiveness  estimates  to 
variations  in  the  discount  rate.  The  prevention 
program — screening  of  school-age  children  for 
high  cholesterol — necessarily  involved  benefits 
deferred  well  into  the  future.  With  costs  and 
benefits  undiscounted,  the  net  cost  per  year  of 
life  saved  ranged  from  $2,441  to  $2,855,  de- 
pending on  assumptions.  Discounting  at  5  per- 


cent produced  a  cost  per  year  of  life  saved  of 
from  $9,353  to  $12,640.  At  10  percent,  dis- 
counting caused  the  figures  to  leap  to  $66,660  to 
$94,460.  These  estimates  compared  with  a  range 
of  $1,782  to  $6,100  per  year  of  life  saved  by 
treatment  alternatives,  depending  on  the  pro- 
gram and  the  discount  rate.  Cretin's  article  not 
only  demonstrated  the  proper  application  of 
discounting,  but  it  emphasized  the  dramatic  ef- 
fect that  varying  the  discount  rate  can  have  on 
net  cost  estimation  and  hence  on  comparison  of 
program  alternatives. 

A  general  CEA/CBA  discounting  question 
has  received  attention  in  the  recent  health  care 
literature:  Should  effectiveness  measures  be  dis- 
counted? Empirically,  the  question  has  been 
answered  in  the  affirmative  by  Cretin  (122), 
Stange  and  Sumner  (513),  and  Weinstein  and 
Stason  (573),  each  of  whom  discounted  effec- 
tiveness measures  of  mortality  avoided  in  the 
future.  The  logic  of  discounting  effectiveness  is 
quite  appealing,  but  the  practice  is  fairly  novel.5 


5Some  analysts  have  argued  that  society's  interests  in  intergen- 
erational  equity,  and  in  the  future  more  generally,  imply  a  social 
rate  of  time  preference  lower  than  the  opportunity  cost  of  capital, 
and  hence  that  the  former  (lower)  rate  should  be  used  to  discount 
benefits  (effectiveness)  and  the  latter  (higher)  to  rate  costs.  This 
conceptual  issue  has  not  arisen  in  the  empirical  studies  in  the 
health  care  CEA/CBA  literature.  However,  it  is  interesting  to  note 
that  both  individual  and  public  decisions  suggest  that  people  often 
behave  in  quite  the  opposite  manner.  For  example,  conscious  deci- 
sions to  continue  smoking  imply  a  heavy  discounting  of  the  future 
relative  to  immediate  gratification.  At  the  societal  level,  public  de- 
cisions to  fund  renal  dialysis,  rather  than  kidney  disease  research, 
screening,  and  prevention  suggest  a  high  social  rate  of  time  pref- 
erence. Of  course,  this  logic  assumes  that,  as  individuals  and  a  col- 
lectivity, we  can  interpret  the  abstraction  of  a  future  death  averted 
by  prevention  as  the  same  "commodity"  as  postponement  of  the 
death  of  a  visibly  ill  individual.  Obviously,  we  cannot  do  this. 
Nevertheless,  behavior  and  decisions  are  far  from  being  consistent 
with  a  low  social  rate  of  time  preference. 


ADDRESSING  PROBLEMS  OF  UNCERTAINTY: 
SENSITIVITY  ANALYSIS 

The  discount  rate  is  only  one  of  numerous  po-  noted  in  chapter  2,  it  is  a  rare  study  that  can  be 
tentially  significant  influences  on  the  magnitude  carried  from  conception  to  empirical  conclusion 
of  cost  and  benefit  (effectiveness)  estimates.  As       without  the  necessity  of  the  analyst's  making 
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assumptions  to  substitute  for  uncertainties,  data 
unavailability,  conceptual  problems,  and  so  on. 
Despite  this,  it  is  not  common  practice  in  health 
care  CEA/CBAs  to  test  the  significance  of  as- 
sumptions. Frequently,  analysts  do  not  care- 
fully distinguish  between  assumptions  and 
sound  empirical  observations. 

Of  the  possible  uses  of  sensitivity  analysis  to 
address  uncertainties,  only  one  has  been  applied 
with  any  degree  of  frequency  in  the  literature: 
the  direct  testing  of  findings  to  determine  if  they 
are  sensitive  to  important  assumptions.  Even 
this  most  common  application  of  sensitivity 
analysis  has  been  used  rather  infrequently,  and 
with  a  few  notable  exceptions,  it  has  been  used 
primarily  for  testing  sensitivity  to  discount 
rates.  The  ability  of  sensitivity  analysis  to  deter- 
mine whether  a  major  uncertainty  precludes  a 
definitive  analysis  does  not  appear  to  have  en- 
couraged analysts  to  tackle  health  care  evalua- 
tion problems  in  which  such  uncertainties  were 
obvious  at  the  outset.  Nor  have  analysts  used 
measurable  costs  and  benefits  to  establish  mini- 
mum or  maximum  values  for  quantified  varia- 
bles in  order  for  a  program  to  appear  worth- 
while. However,  a  few  studies  have  approxi- 
mated such  uses  of  analysis.  Centerwall  and 
Criqui's  (86)  assessment  of  thiamine  fortifica- 
tion of  alcoholic  beverages  allowed  them  to 
avoid  valuing  health  benefits,  since  net  cost  sav- 
ings were  positive. 

Cretin's  (122)  testing  of  the  sensitivity  of  find- 
ings to  variations  in  the  discount  rate  illustrates 
an  appropriate  use  of  sensitivity  analysis  in  its 
most  common  application.  As  Cretin's  analysis 
demonstrated,  program  evaluation  is  highly 
sensitive  to  discounting  when  significant  bene- 
fits (or  costs)  are  deferred  well  into  the  future,  a 
characteristic  of  many  prevention  programs. 
Discounting  the  costs  of  the  cholesterol  screen- 
ing program  by  10  percent  instead  of  5  percent 
increased  costs  per  year  of  life  by  over  600  per- 
cent; for  the  treatment  alternatives,  the  benefits 
of  which  are  more  immediate,  however,  the  cor- 
responding increase  in  costs  was  on  the  order  of 
50  percent.  The  potential  for  such  dramatic  dif- 
ferences explains  why  "responsible  analysts  usu- 
ally offer  the  user  of  analysis  a  sensitivity 


analysis  with  respect  to  the  discount  rate  used" 
(569). 

The  authors  of  several  of  the  more  highly  re- 
garded studies  have  also  tested  the  sensitivity  of 
findings  to  other  uncertainties.  For  many  health 
care  programs,  patient  acceptance  or  compli- 
ance is  both  a  crucial  variable  and  uncertainty, 
and  hence  a  worthy  candidate  for  sensitivity 
testing.  The  literature  provides  several  exam- 
ples. Schoenbaum,  et  al.  (473)  examined  the  ef- 
fect of  acceptance  on  the  optimal  structuring  of 
the  national  swine  flu  immunization  program. 
Eddy's  (158)  analysis  of  breast  cancer  screening 
also  related  such  factors  to  program  design. 
Weinstein  and  Stason's  (573)  study  of  hyperten- 
sion control  demonstrated  how  patient  compli- 
ance can  influence  the  outcomes  of  a  CEA  of  dis- 
ease management. 

The  literature  offers  only  a  few  examples  of 
sensitivity  analysis  applied  to  other  cost  and 
benefit  (effectiveness)  estimations,  but  those  few 
are  instructive.  For  example,  LeSourd,  et  al. 
(327)  found  that  the  absolute  magnitudes  of  in- 
dividual benefit-cost  ratios  of  kidney  disease 
control  alternatives  were  quite  sensitive  to 
variations  in  program  size,  target  screening 
group,  etc.,  but  the  relative  rankings  of  the  ma- 
jor programmatic  alternatives  (e.g.,  screening  v. 
treatment,  and  within  the  latter,  transplantation 
v.  center  dialysis  v.  home  dialysis)  were  unaf- 
fected by  the  tested  variations.  In  addition  to 
testing  sensitivity  to  the  discount  rate,  Cretin 
(122)  included  high  and  low  direct  cost  estimates 
for  the  screening  program.  The  analysis  demon- 
strated less  sensitivity  to  the  direct  cost  estima- 
tion than  to  discounting. 

The  use  of  sensitivity  analysis  reflects  a  more 
sophisticated  appreciation  of  CEA/CBA  than 
that  which  characterizes  most  of  the  existing 
health  care  literature.  At  one  level,  inclusion  of 
thoughtful  sensitivity  analysis  multiplies  the 
number  of  figures  in  an  analysis  and  can  add 
considerable  complexity  to  the  presentation  and 
interpretation  of  findings.  However,  both  logic 
and  empirical  evidence  indicate  that  the  as- 
sumptions of  an  analysis  can  affect  results  sig- 
nificantly. Thus,  both  the  credibility  and  useful- 
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ness  of  CEA/CBA  would  be  increased  by  more 
frequent  and  judicious  use  of  sensitivity  anal- 
ysis. With  the  exception  of  a  handful  of  high- 
quality  studies,  the  existing  health  care  CEA/ 
CBA  literature  lacks  credibility  in  part  because 
issues  of  sensitivity  are  addressed  so  rarely. 

The  use  of  sensitivity  analysis  carries  with  it  a 
risk:  A  "solid"  finding  can  dissolve  under  the 


scrutiny  of  sensitivity  analysis,  and  "nonresults" 
are  less  exciting  and  potentially  less  acceptable 
than  definitive  ones.  Nevertheless,  intellectually 
and  from  the  perspective  of  the  policymaker,  ac- 
curate nonresults  clearly  are  preferable  to  arti- 
ficially precise  ones.  The  bulk  of  the  existing 
literature  does  not  allow  distinguishing  between 
these. 


EXAMINING  ETHICAL  ISSUES 

As  noted  earlier,  one  of  the  limitations  of 
CEA/CBA  is  its  inability  to  handle  distribu- 
tional issues.  Health  care  CEA/CBAs  rarely 
have  grappled  seriously  with  distributional  is- 
sues. Obviously,  selection  of  a  topic  to  study 
may  be  an  implicit  statement  of  concern  with 
distributional  issues,  though  it  is  expressed  in 
terms  of  the  objective  of  the  analysis  rather  than 
as  an  analytical  variable  in  the  CEA/CBA  (e.g., 
the  relatively  large  CEA/CBA  literature  on 
mental  illness  or  geriatric  services).  Health  care 
CEA/CBA  should  not  be  singled  out  for  its  fail- 
ure to  incorporate  distributional  considerations 
successfully.  This  is  the  general  state-of-the-art 
and  perhaps  reflects  one  of  the  inherent  limita- 
tions of  this  form  of  analysis.  But  emphasis  on 
this  limitation  is  particularly  important  in  the 
health  care  literature  where  a  readership  rela- 
tively unfamiliar  with  the  technique  may  be  un- 
duly impressed  by  formalism  and  its  derivative 
conclusions,  failing  to  place  those  conclusions  in 
their  proper  distributional  context.  Many  health 
care  CEA/CBAs  identify  this  concern,  but  it 
seems  buried  by  the  analysis  which  follows  and 
thus  is  frequently  ignored  (177). 

The  literature  offers  few  examples  of  attempts 
to  address  the  problem  of  differentially  valuing 


the  costs  and  benefits  accruing  to  different 
groups  of  people  directly.  Nevertheless,  the 
equity  concern  most  often  debated  in  the  litera- 
ture—  the  valuation  of  life — clearly  relates  to 
this  fundamental  problem,  for  in  CBA  benefits 
are  estimated  according  to  one's  productivity 
(the  human  capital  approach)  or  affluence  (the 
willingness-to-pay  approach).  Less  often  recog- 
nized is  that  CEA  effectiveness  measures  pre- 
sumed to  be  "value-free"  generally  imply  val- 
ues. The  trend  of  the  literature  away  from  CBA 
and  toward  CEA  may  reflect  growing  distaste 
for  explicit  valuation  of  life  or  the  belief  that 
both  conceptual  and  empirical  limitations  make 
the  effort  a  "quixotic  quest  for  a  value  of  life" 
(569).  Of  course,  alternatively,  or  in  addition, 
the  growing  preference  for  CEA  may  simply  re- 
flect the  fact  that  CEA  is  easier  to  understand 
and  perform. 

The  appropriate  handling  of  distributional 
issues  remains  one  of  the  least  developed  fea- 
tures of  CEA/CBA  in  the  health  care  literature 
and  elsewhere.  Even  though  both  theoretical 
and  empirical  progress  can  be  anticipated  (569), 
the  major  problems  of  dealing  with  equity  con- 
cerns seem  unlikely  to  be  resolved  in  the  foresee- 
able future. 


PRESENTING  AND  INTERPRETING  FINDINGS 


As  emphasized  throughout  this  report,  two 
factors  place  a  major  responsibility  on  analysts 
to  present  and  interpret  their  findings  carefully 
and  clearly:  1)  technical  limitations  (inherent  in 
analysis  or  in  the  abilities  of  particular  analysts) 


often  seriously  restrict  the  possibility  of  arriving 
at  unequivocal,  definitive  conclusions;  2)  the 
readership  of  health  care  CEA/CBA  is  generally 
unsophisticated  about  the  techniques  of  this 
form  of  analysis,  though  this  situation  is  chang- 
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ing.  In  addition,  numerous  readers  will  focus 
on,  if  not  limit  their  attention  to,  the  abstracts 
and  conclusions  of  articles. 

An  overall  assessment  of  the  health  care 
CEA/CBA  literature  suggests  that  relatively  few 
analysts  have  addressed  this  responsibility  suc- 
cessfully. Those  few  are  generally  the  authors  of 
the  studies  identified  as  technically  high  quality. 
Of  course,  the  handling  of  the  presentation  and 
interpretation  of  findings  is  a  characteristic 
against  which  the  quality  of  analyses  is  judged, 
but  it  appears  that  a  thoughtful,  useful  conclu- 
sion to  an  analysis  tends  to  follow  a  technically 
and  conceptually  well-conceived  study.  Exam- 
ples abound.  The  analysis  by  Schoenbaum,  et 
al.  (473)  clearly  identified  factors  that  could  in- 
fluence the  success  and  optimal  structure  of  the 
national  swine  flu  immunization  program.  Cre- 
tin's (122)  concluding  analysis  and  remarks 
clarified  the  crucial  role  of  discounting  and  dem- 
onstrated the  need  to  interpret  the  sensitivity 
analysis.  Cretin  purposefully  and  constructively 
made  it  impossible  for  the  reader  to  conclude 
that  there  was  an  obvious  "best"  approach  to  re- 
ducing the  toll  of  myocardial  infarctions.  Stason 
and  Weinstein  (516)  discussed  how  compliance 
and  a  variety  of  other  factors  could  affect  their 
conclusions,  though  Fein  (177)  still  found  it  nec- 
essary to  emphasize  limitations.  Doherty,  et  al. 
(148)  emphasized  information  organization  and 
presentation  in  their  assessment  of  health  pro- 
grams for  the  elderly;  they  refused  to  "reduce" 
their  analysis  to  a  "bottom  line."  The  authors  of 
all  such  studies  seem  to  be  motivated  by  "the 
philosophy  that  it  is  not  so  much  the  results  of  a 
[CBA/CEA]  that  are  likely  to  have  an  impact  on 
policy  as  the  process  of  structuring  information 
in  a  systematic  framework  that  highlights  the 
key  uncertainties  and  the  most  important  value 
tradeoffs"  (569).  This  is  inevitably  reflected  in 
these  analysts'  presentation  and  interpretation 
of  their  findings. 

By  contrast,  most  health  care  CEA/CBAs 
seem  oriented  toward  a  "bottom  line" — gener- 
ally the  estimation  of  a  benefit-cost  or  cost-ef- 
fectiveness ratio.  Aside  from  questions  of  meas- 
urement underlying  the  cost  and  benefit  (effec- 
tiveness) components  of  these  ratios,  even  this 
basic  "bottom  line"  has  been  technically  misin- 


terpreted in  numerous  studies.  At  the  extreme, 
at  least  one  article  with  a  title  beginning  "Cost- 
Benefit  Ratio  .  .  ."  does  not  contain  a  single 
cost-benefit  ratio.  Few  analysts  exhibit  aware- 
ness of  the  deficiencies  of  a  benefit-cost  ratio  as 
compared  with  a  measure  of  net  benefits.  The 
benefit-cost  ratio  clearly  dominates  in  empirical 
health  care  CBAs. 

Cost-effectiveness  ratios,  and  the  words  "cost 
effective,"  are  employed  even  more  uncritically 
than  are  benefit-cost  ratios  in  CBAs.  In  many 
articles,  "cost  effective"  refers  to  one  of  the  two 
words  but  not  both:  That  is,  some  authors  have 
employed  "cost  effective"  when  they  mean  that 
a  program  or  technology  is  effective,  irrespec- 
tive of  cost;  and  other  authors  have  used  "cost 
effective"  to  connote  "cheap,"  irrespective  of  ef- 
fectiveness. There  are  several  instances  of  pur- 
ported CEAs  in  which  only  a  single  program  or 
technology  is  examined  and  is  then  adduced  as 
being  cost  effective,  despite  the  absence  of  an 
alternative  against  which  to  compare  it  (133). 

Subtleties  of  technical  interpretation  of  CEA/ 
CBA  "bottom  lines"  largely  have  escaped  atten- 
tion in  the  health  care  literature.  Only  a  few 
analyses  demonstrated  awareness  that  "cost  ef- 
fectiveness" of  a  use  of  a  technology  need  not 
imply  overall  cost  effectiveness.  For  example,  in 
certain  delivery  settings,  an  automated  electro- 
cardiograph (EKG)  may  be  more  cost  effective 
than  a  manually  read  EKG,  but  if  the  ease  and 
availability  of  the  former  lead  to  excessive  use, 
the  national  EKG  bill  might  actually  rise  with- 
out necessarily  contributing  to  improved  health 
(18).  Perhaps  the  most  dramatic  demonstration 
of  the  difference  between  average  and  marginal 
cost  effectiveness  was  Neuhauser  and  Lewicki's 
(397)  estimation  that  the  cost  per  additional  case 
of  colon  cancer  found  by  repeated  stool  guaiacs 
rose  from  under  $1,200  for  the  first  stool  guaiac 
to  $47  million  for  the  sixth! 

Even  when  the  use  of  a  ratio  or  net  benefit 
measure  is  technically  correct,  lost  in  such  a 
number  are  the  assumptions  that  underlie  it  and 
the  intangible  unmeasured  costs  and  effective- 
ness that  are  excluded  from  it.  A  few  studies 
have  presented  results  in  a  manner  that  makes 
these  factors  clearer.  The  most  common  strate- 
gy has  been  careful  discussion  of  how  the  "bot- 
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torn  line"  could  be  affected  by  such  factors.  Al- 
ternatively, some  authors  have  presented  ranges 
of  results  reflecting  sensitivity  to  assumptions 
(122,327).  A  third  approach,  less  commonly 
adopted,  has  been  to  step  back  from  the  bottom 
line  and  provide  a  tabular  display  of  programs 


and  their  (noncommensurable)  effects.  This  ap- 
proach does  not  yield  a  conclusion  as  to  which 
of  several  competing  programs  is  the  "best,"  but 
it  does  array  alternative  sets  of  consequences  ef- 
fectively and  thereby  might  aid  decisionmakers 
by  clarifying  tradeoffs  (148). 


LINKING  ANALYSIS  TO  POLICY  IMPLEMENTATION 


In  health  care  studies  as  elsewhere,  the  gap 
between  CEA/CBA  studies  and  policy  formula- 
tion almost  invariably  has  been  bridged  by  a 
leap  of  faith  that  assumes  a  theoretically  desir- 
able program  can  be  translated  readily  and 
directly  into  an  operational  one.  Health  care 
CEA/CBAs  always  have  had  a  policy  orienta- 
tion, but  the  literature  is  nearly  devoid  of 
empirical  attempts  to  make  the  adjustments 
(needed  to  reflect  political  and  cost  realities) 
proposed  in  the  new  literature  linking  analysis 
to  policy  implementation  (336).  Health  care 
CEA/CBA  perhaps  should  not  be  faulted  for 
this  lack;  the  implementation  literature  is  simply 
too  new. 

Luft  (336)  in  a  contribution  to  the  implemen- 
tation literature,  used  two  health  care  examples, 
development  of  freestanding  surgicenters  and 
use  of  work  evaluation  units  "for  objective 
testing  of  functional  work  capacity  to  supple- 
ment the  usual  information  concerning  the 
health  status  of  patients  who  have  recently  had 
a  myocardial  infarction."  Through  these  exam- 
ples, he  demonstrated  how  role  players'  differ- 
ing interests  can  block  implementation  of  social- 
ly desirable  programs,  and  how  analysts  can  use 
recognition  of  differing  interests  and  influences 
in  developing  predictive  CBAs.  Empirical  appli- 
cation of  this  important  conceptual  contribution 
might  increase  the  realism  and  usefulness  of 
CEA/CBAs. 


Though  not  formally  employing  Luffs  ap- 
proach, a  few  studies  have  observed  how  inter- 
ests might  be  expected  to  block  or  inhibit  im- 
plementation of  socially  desirable  programs.  In 
a  recent  study  which  concluded  that  in  certain 
large  delivery  settings,  automated  electrocar- 
diography may  represent  a  cost-effective  al- 
ternative to  traditional  manual  readings,  for  ex- 
ample, the  investigators  suggested  that  diffusion 
of  this  technology  might  be  inhibited  by  cardi- 
ologists, to  whom  it  could  represent  a  threat  to 
reading  fees  and  a  change  in  referral  patterns 
(18). 

Another  proposal  that  can  be  found  in  the  lit- 
erature is  that  analyses  should  build  in  a  con- 
sideration of  the  sensitivity  of  basic  findings  to 
unanticipated  cost  overruns.  We  are  not  aware 
of  any  health  care  CEA/CBAs  that  have  done 
this,  but  there  are  numerous  examples  of  studies 
in  which  it  might  have  been  done.  One  example 
is  the  study  by  Schoenbaum,  et  al.  (473).  These 
analysts  could  not  have  anticipated  the  Guil- 
lain-Barre  syndrome — and  the  resultant  costs — 
which  accompanied  the  national  swine  flu  im- 
munization program.  The  program  experienced 
significant  additional  production  and  distribu- 
tion costs,  however,  and  the  analysts  might 
have  explored  the  implications  of  unanticipated 
cost  overruns.  Analyses  of  future  proposed  pub- 
lic health  programs  might  consider  doing  so. 


CONCLUSION 

The  assessment  in  this  chapter  of  the  quality 
of  the  health  care  CEA/CBA  literature  has  re- 
lied primarily  on  judgments  of  how  the  practice 
of  analysis  compares  with  a  set  of  theoretical 


standards.  Two  caveats  related  to  this  approach 
must  be  recognized.  One  is  that  words  like  "cost 
effective"  have  been  used  in  the  literature  much 
more  freely  than  they  would  have  been  had  all 
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authors  meant  to  adhere  to  strict  CEA/CBA 
definitions.  Nevertheless,  since  articles  em- 
ploying these  words  freely  contribute  to  the 
health  care  community's  perception  of  the 
meaning  of  terms  and  uses  of  analysis,  it  is  ap- 
propriate to  include  them  in  a  review  of  CEA/ 
CBA  literature. 

The  second  caveat  is  that  several  of  the  stand- 
ards of  ideal  (or  idealized)  analysis  may  be  un- 
attainable. If  so,  a  review  of  the  literature  will 
necessarily  have  a  critical  tone.  Many  of  the 
flaws  of  the  health  care  CEA/CBA  literature  re- 
flect inherent,  or  at  least  very  common,  analyti- 
cal problems.  Examples  include  difficulties  in- 
corporating distributional  concerns  into  formal 
analysis  and  deficiencies  of  data  accessibility, 
quality,  and  consistency.  Some  common  CEA/ 
CBA  problems  impose  unusually  severe  burdens 
on  health  care  studies.  The  difficult  and  often 
controversial  valuation  of  less  tangible  costs 
and  benefits,  such  as  the  saving  of  life  and  re- 
duction of  physical  suffering  and  emotional  dis- 
tress, is  often  central  to  the  health  care  analyst's 
chore.  Even  more  basically,  the  estimation  of 
production  relationships  seems  particularly 
challenging  in  health  care,  where  the  difficulty 
of  attributing  health  outcomes  to  health  care  in- 
puts has  led  many  scholars  to  rely  for  evalua- 
tion on  intermediate  (nonoutput)  measures  such 
as  structure  and  process.  Technical  change  oc- 
curs with  such  extraordinary  rapidity  that 
forward-looking  health  care  CEA/  CBAs  are 
particularly  handicapped.  Furthermore,  even 
some  commonly  accepted  "second-best"  CEA/ 
CBA  practices  are  hard  to  justify  in  health  care 
CEA/CBA,  one  example  being  the  use  of  mar- 
ket prices  as  measures  of  true  opportunity  costs. 

Not  all  of  the  flaws  in  the  health  care  lit- 
erature are  attributable  to  inherent  difficulties. 
The  relative  novelty  of  CEA/ CBA  in  health  care 
seems  to  account  for  the  exaggerated  impor- 
tance of  several  errors.  Representative  are  the 
absence  or  mishandling  of  discounting  and  the 
presentation  of  purported  CEAs  that  examine 
only  one  program  (i.e.,  no  alternatives)  and 
conclude  that  it  is  cost  effective.  More  sig- 
nificant is  the  tendency  of  investigators  to  use 
purely  retrospective  evaluation  of  existing  pro- 
grams to  develop  policy  proposals  for  the  fu- 


ture, with  little  or  no  regard  for  the  changes  that 
will  transform  the  structure  and  functioning  of 
such  programs.  Many  studies  are  plagued  fur- 
ther by  the  "black  box"  approach  to  ascertain- 
ing production  relationships:  The  identification 
of  inputs  and  outputs  without  devoting  suffi- 
cient attention  to  the  efficiency  of  production, 
or  even  to  basic  questions  of  causation  versus 
correlation. 

By  contrast,  the  best  of  health  care  CEA/ 
CBA  makes  the  novelty  of  the  literature  a 
source  of  encouragement.  A  handful  of  skilled 
analysts  are  breaking  methodological  and  sub- 
stantive ground,  working  on  evaluative  tech- 
niques, and  producing  informative,  thought- 
provoking  analyses.  In  recent  years,  investiga- 
tors have  demonstrated  how  analysis  can  yield 
insight  into  the  nature  of  timely  policy  issues 
(473), 6  contribute  to  efficient  program  planning 
(158),  grapple  with  technical  evaluation  prob- 
lems (573),  and  address  inadequately  studied 
technical  aspects  of  medicine,  such  as  diagnosis 
(360,559).  Such  works  may  presage  a  variety  of 
interesting,  useful  developments  in  a  field  whose 
novelty  provides  a  set  of  wide-open  methodo- 
logical and  substantive  opportunities. 

Illustrative  of  recent  methodological  devel- 
opments of  considerable  promise  is  the  growing 
analytical  comprehensiveness  of  CEAs  and  the 
trend  away  from  comparing  direct  program 
costs  with  single-outcome  measures  of  effec- 
tiveness (e.g.,  "lives  saved").  Recent  efforts  to 
incorporate  indirect  costs  and  develop  more  in- 
clusive indexes  of  effectiveness  (e.g.,  QALYs) 
have  begun  to  transfer  a  major  virtue  of  CBA — 
its  comprehensiveness — to  CEA,  while  greatly 
reducing  the  accompanying  problem  of  explicit- 
ly valuing  noneconomic  health  benefits.  Several 
studies  demonstrate  comprehensive  cost  ac- 
counting, with  both  positive  costs  and  "negative 
costs" — indirect  economic  benefits — aggregated 


"The  analysis  of  the  national  swine  flu  immunization  program 
(473)  was  conceived,  in  part,  as  an  experiment  to  see  whether  a 
formal  analysis,  relying  heavily  on  concurrence  of  expert  opinion 
(through  use  of  a  Delphi),  could  be  accomplished  quickly — prior 
to  a  policy  decision — and  still  produce  useful  information.  Despite 
its  limitations — failure  to  anticipate  social,  legal,  and  medical 
problems  and  their  economic  sequelae — the  analysis  served  to  in- 
form and  put  issues  into  perspective  for  much  of  the  health  care 
community. 
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on  the  cost  side  of  the  CEA  equation.  The  re- 
maining noneconomic  values  constitute  the  pro- 
grams' effectiveness.  In  some  instances,  the  re- 
maining effectiveness  measure  is  a  simple  single 
outcome — sterilization,  for  example  (134) — 
while  in  others  it  is  a  more  complex  index,  such 
as  QALYs  in  hypertension  control  (573).  In  still 
others,  effectiveness  measurement  or  valuation 
is  made  irrelevant  by  the  fact  that  complete  cost 
accounting  indicates  a  positive  net  benefit  be- 
fore "remaining  effectiveness"  is  taken  into  ac- 
count (86).  The  narrowing  of  the  gap  between 
CBA  and  CEA  is  made  vividly  clear  by  this  last 
case.  It  is  also  interesting  to  note  that  Cretin 
(122)  called  her  study  a  CBA,  yet  she  did  not 
place  a  dollar  value  on  years  of  life  saved  and 
she  presented  results  in  terms  of  costs  per  added 
years  of  life — a  typical  CEA  "bottom  line."  One 
might  be  tempted  to  dismiss  this  as  a  case  of 
mislabeling,  but  in  fact  the  growing  economic 
sophistication  and  comprehensiveness  of  CEAs 
have  introduced  a  healthy  terminological 
ambiguity. 

OTA's  assessment  of  the  quality  of  the  litera- 
ture has  relied  on  a  comparison  of  practice  to  a 
set  of  theoretical  standards.  Nevertheless,  there 
are  other  bases  for  assessment  of  quality.  For  ex- 
ample, if  one  believes  that  quality  is  best  re- 
flected in  the  validity  and  reliability  of  results, 
one  might  seek  internal  or  external  measures  of 
validity  and  reliability.  An  example  of  an  inter- 
nal measure  is  comparison  of  findings  across 
studies  of  the  same  topic.  To  be  sure,  one  must 
be  wary  of  one  study's  replicating  the  method  of 
earlier  studies,  or  of  use  of  the  same  data 
sources  leading  to  a  shared  bias  (i.e.,  consistent 
but  not  valid  results).  In  the  absence  of  a  shared 
bias,  however,  consistency  of  results  is  sug- 
gestive of  meaningful  findings. 

The  literature  does  provide  a  few  cases  of 
multiple  analyses  of  a  single  subject.  Studies  of 
renal  disease  treatment  offer  an  excellent  exam- 
ple. Two  contemporary  analyses  ranked  treat- 
ment alternatives  in  the  same  order — transplan- 
tation being  most  cost  effective  in  one  study 
(298)  and  cost  beneficial  in  the  other  (327),  fol- 
lowed in  both  studies  by  home  dialysis,  and 
last,  center  dialysis.  These  results  were  con- 
firmed in  a  study  published  10  years  later  using 


more  recent  data  (513).  Similarly,  three  separate 
studies  of  PKU  screening  concluded  that  this  is  a 
socially  desirable  medical  practice  (78,517,553). 
By  contrast,  analyses  of  CT  scanning  have  pro- 
duced widely  discrepant  findings,  reflecting  dif- 
ferences between  head  and  body  scanning,  tech- 
nical changes  (realized  and  anticipated)  over  the 
time  period  covered  by  the  studies,  and  differ- 
ences in  investigators'  perspectives  as  to  what 
constitutes  effectiveness  in  scanning  or,  more 
generally,  in  diagnosis  (2,28,211).  Although  a 
systematic  comparison  of  analyses  on  single 
subjects  was  not  attempted  in  this  review,  that 
might  prove  to  be  an  enlightening  approach  to 
evaluating  the  literature. 

Assessment  of  the  quality  of  individual  con- 
tributions to  the  literature  has  received  primary 
attention  in  this  chapter.  Chapter  1  and  appen- 
dix A  examined  the  overall  composition  of  the 
literature,  but  "quality"  judgments  were  limited 
to  observation  of  the  conspicuous  absence  of 
certain  substantive  concerns,  such  as  important 
disease  problems  (e.g.,  diabetes)  and  medical 
techniques  (e.g.,  a  large  number  of  diagnostic 
techniques  other  than  screening).  Here  it  should 
be  noted  that  an  interesting  indication  of  the 
overall  composition  of  the  literature  is  the  mix 
of  CEA/CBAs  with  positive  and  negative  find- 
ings. If  some  medical  practices  are  socially  and 
economically  desirable  and  others  undesirable 
(or  of  questionable  desirability),  one  might  ex- 
pect a  "balanced"  literature  to  include  a  good 
mix  of  positive  and  negative  findings.  A  lack  of 
balance  certainly  need  not  reflect  poorly  done 
individual  studies.  Rather,  it  might  result  from 
analysts'  having  a  systematic  bias  in  favor  of 
studying  desirable  or  undesirable  programs.  For 
example,  if  CEA/ CBA  were  applied  primarily 
to  analyzing  programs  whose  worth  has  been 
challenged,  one  might  anticipate  a  preponder- 
ance of  negative  findings  in  the  health  care 
CEA/CBA  literature.  A  preponderance  of  posi- 
tive findings  could  follow  from  medical  profes- 
sionals' analyzing  (or  commissioning  analyses 
of)  projects  whose  diffusion  into  practice  they 
favor.  Dominance  of  either  positive  or  negative 
findings  might  reflect  systematic  underestima- 
tion or  overestimation  of  either  benefits  or 
costs.  For  example,  as  discussed  above,  few 
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analyses  include  a  realistic  assessment  of  the 
costs  of  implementing  a  policy  and  of  the  possi- 
ble dilution  of  benefits  that  may  follow.  These 
factors  should  produce  overly  optimistic  results, 
i.e.,  they  introduce  a  distinct  bias  toward 
positive  findings.  On  the  other  hand,  many 
health  care  programs  are  characterized  by  im- 
portant intangible  benefits,  the  value  of  which 
frequently  is  not  incorporated  into  analysis. 
This  factor  introduces  a  bias  toward  unduly 
negative  findings. 

The  reading  of  the  literature  suggests  a  domi- 
nance of  studies  having  positive  findings.  To  be 
sure,  there  are  notable  exceptions,  with  some 
analyses  producing  distinctly  negative  findings 
(28,365,397,570)  and  surprisingly  few  deriving 
equivocal  results  (ll).7  Also,  there  may  be  a 
shift  taking  place,  with  movement  from  the 
positive  toward  the  negative.  This  could  reflect 
the  general  questioning  of  medical  technology 
and  growth  of  cost  consciousness,  both  of  which 
emerged  strongly  in  the  1970's. 

Chapter  1  noted  that  this  report  was  restricted 
to  considering  personal  health  care  services.  In 
concluding  this  review  of  the  literature,  it  seems 
appropriate  to  observe  that  the  community  of 
health  care  CEA/CBA  analysts  seems  to  have 
established  a  similar  boundary.  Unless  policy- 
makers and  analysts  remain  cognizant  of  the 
existence  of  that  border  and  its  implications, 
this  limitation  can  mislead  technical  aspects  of 
analysis  and,  more  importantly,  reinforce 
narrower  views  of  health  resource  allocation. 
A  prominent  example  of  a  technical  problem  is 

7It  can  be  argued  that  it  takes  a  strong  constitution  to  present 
equivocal  findings.  There  is  a  common  perception  that  the  publica- 
tion market  prefers  "definitive"  to  ambiguous  findings.  This  is  re- 
flected in  the  CEA/CBA  literature  in  which  equivocal  results  seem 
to  be  much  more  rare  than  probabilities  would  lead  one  to  expect. 
Although  OTA's  literature  search  discovered  a  preponderance  of 
studies  with  positive  findings,  there  appeared  to  be  many  more 
studies  with  negative  than  with  ambiguous  findings.  Those  with 
ambiguous  findings  tend  to  be  competent  analyses,  their  ambigui- 
ty often  reflecting  allowance  for  variation  in  uncertain  parameters 
(e.g.,  122). 


the  recent  emphasis  on  measuring  "net  health- 
care cost"  in  CEAs  (574).  The  socially  relevant 
concept  should  perhaps  be  net  social  cost,  in 
which  net  health-care  cost  is  but  one  important 
component. 

One  of  the  drawbacks  that  can  arise  from  lim- 
iting policy  analysis  to  medical  care  parochial- 
ism is  a  failure  to  explore  the  possibility  of  cost- 
effective  alternatives  to  personal  health  services. 
In  the  effort  to  reduce  mortality  and  disability 
due  to  motor  vehicle  accidents,  how  might  high- 
way safety  efforts — technical  (e.g.,  safer  road 
surfaces  and  shoulder  barriers),  legal  (e.g.,  in- 
creased law  enforcement),  etc. — compare  with 
improved  emergency  medical  services?  To  re- 
duce hypertension-related  mortality  and  mor- 
bidity, what  is  the  appropriate  mix  of  medical 
interventions  and  community  health  education 
on  risk  avoidance?  There  is  a  paucity  of  com- 
parative analyses  crossing  the  medical-nonmed- 
ical,  or  personal  health-public  health,  border.  A 
noteworthy  exception  is  comparison  of  commu- 
nity water  fluoridation  with  a  variety  of  indi- 
vidual treatment  approaches  to  preventing  den- 
tal caries.  Noting  this  paucity  is  not  meant  to 
reflect  adversely  on  either  existing  or  future  in- 
dividual contributions  to  the  health  care  litera- 
ture—the quantity  and  importance  of  analyses 
of  specific  medical  problems  and  technologies  is 
sure  to  grow,  a  development  to  be  desired. 
Rather,  it  is  to  suggest  that  policymakers,  health 
planners,  and  individual  health  practitioners 
would  benefit  from  the  widening  of  perspective 
that  "border-crossing"  analyses  could  offer.8 

8A  budgetary  pragmatist  might  argue  that  medical  and  nonmed- 
ical resource  allocations  are  bureaucratically  independent,  with 
border-crossing  reallocations  extremely  unlikely,  and  hence  that 
border-crossing  analysis  is  not  worthwhile.  Although  this  may  be 
true  in  the  short  run,  relative  resource  allocations  do  change  over 
time  and  might  be  responsive  to  analytical  input.  Clearly,  this  is 
occurring  at  present  in  the  new  Federal  Government  prevention 
initiatives  within  HEW  (743).  More  to  the  point,  however,  is 
OTA's  finding  that  one  important  strength  of  analysis  is  its  ability 
to  affect  thinking  about  problems — perspective — and  not  the  mak- 
ing of  explicit  resource  allocation  decisions. 
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INTRODUCTION 

OTA's  assessment  discovered  no  consensus 
among  analysts  and  practitioners  as  to  a  stand- 
ard method  of  cost-effectiveness  analysis/cost- 
benefit  analysis  (CEA/CBA),  although  it  did 
find  agreement  that  no  one  method  is  appropri- 
ate for  any  two  classes  of  technologies  or  for 
any  two  situations  under  which  a  technology  is 
being  assessed.  In  general,  the  disagreement  on 
precise  methodology  is  due  more  to  the  inherent 
nature  of  the  analysis,  the  type  and  stage  of  de- 
velopment of  the  technology  being  analyzed, 
and  the  general  social  and  political  environment 
of  decisionmaking  than  it  is  to  the  maturity  of 
the  methodology  of  CEA/CBA. 

OTA  believes  that  the  fundamental  approach 
to  CEA/CBA  should  be  based  on  clear,  logical 
thinking,  using  explicit  criteria  within  the 
framework  of  generally  accepted  methodologi- 
cal principles.  OTA  also  considers  the  distinc- 
tion between  CEA  and  CBA  to  be  largely  aca- 
demic and  believes  that  valuation  of  intangibles, 
such  as  life  and  quality  of  life,  should  be  gov- 
erned more  by  factors  external  to  the  analysis 
than  by  the  methodological  approach  itself. 

This  latter  point  requires  further  comment. 
During  the  Case  Study  Authors'  Workshop, 
conducted  as  part  of  this  assessment,  it  was 
agreed  that  certain  aspects  of  the  method  which 
is  chosen  for  a  given  analysis  will  be  governed 
by  the  intended  audience.  This  finding,  in  effect, 
implies  that  CEA/CBA  is  subject  to  systematic 
methodological  bias.  One  example  of  such  bias 
would  be  limiting  the  scope  of  a  study  to  com- 
pare certain  alternatives  but  not  others,  e.g., 
comparing  respiratory  therapy  treatments  with 
each  other  but  not  including  the  option  of  no 
treatment  (468).  Another  example  would  be 
considering  some  effects  or  benefits  but  not 
others,  e.g.,  examining  direct  economic  costs 
and  benefits  of  alternative  therapies  but  not  ex- 
amining convenience  or  anxiety  factors  (304). 


Such  systematic  bias  is  not  wrong  methodo- 
logically; rather,  it  is  a  reflection  of  the  fact  that 
CEA/CBA  is  often  part  of  a  political  process. 
For  instance,  if  a  health  systems  agency  wishes 
to  assess  the  value  of  an  alcoholism  program,  or 
if  alcohol/drug  abuse  proponents  wish  to  argue 
for  increasing  funding  for  their  programs,  it  is 
legitimate — methodologically  and  politically — 
to  estimate  net  societal  economic  gain,  including 
increased  productivity  (i.e.,  lost  wages  averted). 
On  the  other  hand,  if  the  Health  Care  Financing 
Administration  is  trying  to  determine  whether, 
and  for  whom,  artificial  heart  surgery  or  bone 
marrow  transplant  should  be  reimbursed,  the 
use  of  increased  productivity  as  a  criterion  may 
be  less  acceptable  politically. 

A  related  consideration  is  whether  an  analysis 
is  being  used  to  propose  increased  funding  for  a 
new  or  an  existing  program,  or  whether  it  is  be- 
ing used  to  recommend  curtailment  of  an  exist- 
ing program.  In  the  former  case,  almost  any  fac- 
tor which  helps  to  make  the  case  for  increased 
funding  is  politically  acceptable— including  in- 
creased wages  of  a  more  productive  population. 
In  the  latter  case — curtailing  a  health  program — 
it  is  often  unacceptable  to  use  net  changes  in 
wages  as  a  criterion,  since  many  feel  that  pro- 
grams should  not  be  denied  on  the  basis,  even  in 
part,  of  a  person's  potential  earning  ability. 
OTA's  finding,  therefore,  is  that  since  there  are 
a  variety  of  acceptable  ways  to  perform  a  CEA/ 
CBA,  and  since  the  results  of  an  analysis  often 
are  affected  by  the  methods  chosen,  it  is  very 
important  that  the  process  of  the  analysis  be  ex- 
plicit in  order  to  allow  for  public  scrutiny.  In  a 
sense,  the  process  of  a  CEA/CBA  may  be  more 
important  than  the  results. 

In  addition,  OTA  finds  a  paucity  of — and 
consequently  a  need  for — improved  data,  with- 
out which  good  analyses  are  impossible.  For  ex- 
ample, efficacy  and  effectiveness  information 
for  many  technologies  is  generally  not  avail- 
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able;  health  care  utilization  data  are  often  either 
not  available  or  not  available  in  a  standard  or 
accessible  format;  and  cost  data  are  often  inac- 
curate and  also  nonstandardized.  Members  of 
the  advisory  panel  for  the  assessment  and  case 
study  authors  expressed  the  conviction  that 
since  each  specific  analysis  often  requires  a 
unique  data  set  that  will  not  be  available  in  even 
the  best  of  routine  data  collection  systems,  bet- 
ter routine  data  collection — although  desirable 
and  possibly  necessary  for  better  analyses — is 
ordinarily  not  sufficient.  Therefore,  an  opti- 
mum mix  of  routine  data  collection  and  study- 
specific  data  collection  needs  to  be  defined,  and 
when  studies  are  funded,  attention  should  be 
given  to  include  funds  for  data  collection. 

The  National  Center  for  Health  Statistics 
(NCHS)  is  an  agency  within  the  Office  of  the 
Assistant  Secretary  for  Health  of  the  Depart- 
ment of  Health  and  Human  Services  and  is  one 
of  the  principal  health  services  research  agencies 
of  the  Federal  Government.  NCHS  has  played  a 
major  role  in  the  development  of  national  health 
statistics  policy  and  programs.  Under  its  current 
mandate — the  Health  Services  Research,  Health 
Statistics,  and  Medical  Libraries  Act  of  1974 
(Public  Law  93-353)— NCHS  is  responsible  for 
collecting  and  disseminating  health  data  in- 
cluding information  on  the  costs  of  illness, 
health  care,  and  health  financing. 

The  importance  of  data  collected  by  NCHS 
cannot  be  overemphasized.  Such  information  as 
incidence  and  prevalence  rates  of  diseases,  natu- 
ral history  of  disease,  medical  care  utilization, 
work  loss,  surgical  rates,  and  premature  mor- 
tality is  crucial  to  CEA/CBA.  NCHS  has  con- 
ducted cost-of-illness  studies,  and  these  have 
been  used  in  other  agencies'  CBAs  and  CEAs. 
Currently,  NCHS  staff  are  coordinating  an  in- 
teragency Public  Health  Service  Cost  of  Illness 
Committee  which  is  examining  the  state-of-the- 
art  of  estimating  costs  of  illness  and  disability. 

There  is  also  an  expanding  literature  related 
to  health  status  measurement.  This  maturing 
field  is  important  to  health  care  technology 
assessment  in  general  and  CEA/CBA  in  particu- 
lar. It  may  have  the  potential  to  capture,  in  a 
very  useful  format,  aggregate  measures  of,  and 
changes  in,  health  status  which  are  much  more 


inclusive  than  single  health  statistics  or  health 
indicators,  such  as  mortality  rates  or  disability 
rates.  The  relationship  between  health  statistics, 
health  indicators,  and  health  indexes  has  been 
characterized  by  Murnaghan  (738)  and  is  shown 
in  figure  3.  Health  statistics  can  be  thought  of  as 
basic  data  such  as  number  of  hospital  admis- 
sions. Health  indicators  are  processed  data  that 
aggregate  information  of  similar  type  and  are 
often  expressed  in  terms  of  percentages,  rates, 
and  ratios.  The  main  methodological  issue  in  re- 
gard to  health  indicators  is  reliability,  not 
validity  (738).  Health  status  indexes  (HSIs), 
however,  are  considerably  more  complex  and 
controversial.  In  general,  such  indexes  attempt 
to  combine  multiple  indicators  such  as  disability 
and  death  into  a  single  expression.  Usually  an 
index  scale  is  used  (e.g.,  a  scale  from  zero  to  10, 
where  zero  represents  death  and  10  represents 
perfect  health).  The  methodological  issues  in  re- 
gard to  health  indexes  are  reliability  (i.e.,  do  re- 
peated measurements  provide  the  same  infor- 
mation?), validity  (i.e.,  is  the  relative  weighting 
system  correct?),  and  definitional  consistency 
(i.e.,  what  constitutes  "health"?). 

Notwithstanding  the  considerable  progress  in 
solving  these  methodological  issues  (e.g.,  708, 
711,732,733),  OTA  finds,  with  notable  excep- 
tions (406,516),  considerable  reluctance  within 
the  general  health  care  research  community  to 
accept  the  validity  of  HSIs.  Part  of  this  reluc- 
tance seems  to  be  related  to  the  immaturity  of 
the  research  effort.  For  instance,  there  are 
several  concurrent  research  efforts  underway  to 
develop  an  HSI,  each  method  being  related  but 
still  quite  different  from  the  others.  Also,  as 
noted  above,  reliability  and  validity  studies  are 
still  underway.  The  other  major  reason  for  the 
reluctance  of  the  research  community  to  accept 
and  use  HSIs  seems  to  be  a  lack  of  understand- 
ing of  the  techniques.  For  instance,  although 
most  serious  CEA/CBA  analysts  are  aware  of 
the  HSI  literature  and  of  its  potential  in  their 
own  work,  evidently,  very  few  of  them  have 
assessed  for  themselves  its  validity.  Conse- 
quently, in  their  own  writing  most  researchers 
are  content  to  acknowledge  the  HSI  research  un- 
derway, but  few  feel  confident  in  actually  using 
it.  In  summary,  OTA  finds  that  research  efforts 
to  develop  indexes  of  health  are  producing  im- 
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Figure  3.— The  Relationship  Between  Health  Statistics,  Health  Indicators,  and  Health  Indexes 


Health 
indicators 


SOURCE:  Office  of  Technology  Assessment. 


portant  results,  but  that  these  efforts  have 
neither  been  fully  evaluated  nor  widely  accepted 
by  the  applied  research  community.  The  lack  of 
acceptance  is  probably  more  related  to  the  im- 


maturity of  the  field  and  to  the  neglect  of  eval- 
uation than  to  a  rejection  of  the  methodology. 
Further  study  of  the  validity  and  usefulness  of 
HSIs  appears  to  be  warranted. 


METHODOLOGICAL  LIMITATIONS 

The  methodological  weaknesses  or  shortcom- 
ings of  CEA/CBA  are  of  two  general  types: 
1)  those  that  are  inherent  in  this  form  of  analy- 
sis, and  2)  those  that  are  due  to  the  lack  of  ma- 
turity in  the  state  of  the  art  of  CEA/CBA  and  to 
the  lack  of  analyst  expertise  and  experience  with 
CEA/CBA  in  health  care.  The  latter  can  be  ex- 
pected to  diminish  as  more  experience  accumu- 
lates. The  10  principles  for  analysis  presented 
later  in  this  chapter  are  directly  relevant  to 
lessening  what  will  be  referred  to  below  as 
"weaknesses  due  to  immaturity."  The  "weak- 
nesses inherent  in  CEA/CBA,"  however,  are 
likely  to  remain  significant  barriers  to  the 


usefulness  of  CEA/CBA  in  health  care  deci- 
sionmaking. 

Weaknesses  Inherent  in  CEA/CBA 

Examples  of  weaknesses  which  are  considered 
as  inherent  are:  1)  the  difficulty  of  predicting 
with  precision  the  costs  and  benefits  of  new  or 
not  yet  existing  programs  or  technologies, 
2)  fundamental  problems  in  quantifying  or  valu- 
ing certain  important  but  less  tangible  health 
benefits,  3)  controversy  over  the  appropriate 
discount  rate,  4)  the  inability  of  analyses  to  ade- 
quately incorporate  equity  considerations,  and 
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5)  the  inevitability  of  significant  uncertainty  of 
important  variables  even  in  a  perfectly  managed 
study.  In  addition,  the  rapidity  and  profundity 
of  change  in  technological  medicine  exacerbate 
the  analytical  process,  a  problem  felt  particular- 
ly acutely  because  the  point  at  which  an  analysis 
might  have  the  most  significant  impact  on 
health  resource  allocation — before  a  technology 
has  diffused  into  widespread  medical  prac- 
tice— is  also  the  point  at  which  uncertainties  are 
most  often  encountered.  Although  sensitivity 
analysis  sometimes  can  demonstrate  that  inher- 
ent technical  analytical  problems  do  not  affect 
qualitative  conclusions,  nevertheless  such  diffi- 
culties frequently  preclude  a  definitive  assess- 
ment of  a  program.  In  any  case,  the  uncertain- 
ties which  pervade  analyses  severely  restrict  the 
potential  of  studies,  however  high  quality,  to 
resolve  definitively  the  "close  calls"  in  which 
alternative  programs  are  similar  in  both  cost 
and  effectiveness. 

Another  inherent  weakness,  discussed  earlier, 
concerns  the  systematic  methodological  bias 
which  results  when  CEA/CBA  studies  are  tai- 
lored to  consider  certain  costs  and  benefits/ 
effectiveness  and  not  others.  Such  bias,  due 
either  to  political  considerations  or  to  the  type 
and  stage  of  the  technology  being  evaluated,  is 
inevitable. 

Weaknesses  Due  to  Immaturity 

Many  of  the  problems  associated  with  the  ap- 
plication of  CEA/CBA  in  the  health  field  are 
due  to  the  relative  newness  of  the  technique.  In 
some  cases,  the  problems  stem  from  a  lack  of 
agreement  among  the  research  community  (e.g., 
concerning  the  precise  specification  of  costs,  the 
inclusion  of  future  medical  costs  saved).  In 
other  cases,  sufficient  information  is  unavail- 
able (e.g.,  population-based  utilization  data  are 


not  known,  or  efficacy  and  safety  are  un- 
known). Also  related  to  the  relative  newness  of 
CEA/CBA  is  the  finding  that  the  number  of 
studies  demanded  is  greater  than  the  number 
analysts  can  perform.  Consequently,  insuffi- 
ciently trained  program  staff,  health  care  practi- 
tioners, and  public  policy  analysts  are  doing 
analyses — often  failing  to  follow  generally  ac- 
cepted, but  until  now  not  widely  disseminated, 
principles  of  analysis  (e.g.,  discounting  costs 
and  benefits,  performing  sensitivity  analysis, 
identifying  alternative  programs,  and  measur- 
ing opportunity  costs). 

Although  there  are  fairly  few  examples  of 
technically  high-quality  CEA/CBA  studies  in 
the  health  literature  today,  this  situation  may 
change  as  the  state  of  the  art  of  CEA/CBA  ma- 
tures and  as  analysts  and  decisionmakers  gain 
more  experience  with  CEA/CBA  in  health  care. 
There  should  be  a  reduction  in  the  number  of 
problems  due  to  immaturity  such  as:  inappro- 
priate or  inaccurate  specification  of  production 
relationships;  inadequate  identification  of  alter- 
natives, measurement  or  valuation  of  costs  or 
benefits;  lack  of  discounting  of  future  costs  and 
benefits;  and  failure  to  examine  sensitivities.  Al- 
though one  should  not  underestimate  the  diffi- 
culty of  producing  a  technically  high-quality 
study,  in  principle  such  problems  can  be  re- 
solved; clearly  the  practice  of  analysis  can  and 
should  improve  over  time.  Also,  in  time,  both 
analysts  and  policymakers  may  better  under- 
stand the  inherent  limitations  of  CEA/CBA  so 
as  to  make  use  of  such  analyses  in  a  more  realis- 
tic perspective.  Thus,  the  usefulness  of  CEA/ 
CBA  seems  likely  to  increase  in  the  future.  The 
10  principles  of  analysis  presented  below  are 
suggested  as  one  method  of  minimizing  not  only 
weaknesses  of  immaturity,  but  also  weaknesses 
that  are  inherent  to  the  technique. 


TEN  PRINCIPLES  OF  CEA/CBA  METHODOLOGY 

There  is  widespread  agreement  that  10  basic  circumstances  under  which  a  societally  oriented 
principles  of  CEA/CBA  methodology  apply  re-  analysis  takes  place.  These  10  principles  are  dis- 
gardless  of  the  technology  being  assessed  or  the       cussed  below.  (See  table  2.) 
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Table  2.— Ten  General  Principles  of  Analysis 
(for  CEA/CBA  methodology) 

1.  Define  problem. 

2.  State  objectives. 

3.  Identify  alternatives. 

4.  Analyze  benefits/effectiveness. 

5.  Analyze  costs. 

6.  Differentiate  perspective  of  analysis. 

7.  Perform  discounting. 

8.  Analyze  uncertainties. 

9.  Address  ethical  issues. 
10.  Interpret  results. 

SOURCE:  Office  of  Technology  Assessment. 

1.  Define  Problem 

The  problem  should  be  clearly  and  explicitly 
defined  and  the  relationship  to  health  outcome 
or  health  status  should  be  stated.  The  problem, 
for  example,  could  be  expressed  in  terms  such  as 
"excess  infection  rate"  or  "excess  deaths."  The 
broader  the  definition  of  the  problem,  the  more 
relevant  alternatives  there  are  to  examine:  "Ex- 
cess deaths,"  for  example,  could  lead  to  compar- 
ing any  preventive  or  therapeutic  program 
which  decreases  mortality;  excess  deaths  due  to 
cancer,  however,  would  limit  the  scope  of  study 
considerably;  and  excess  deaths  due  to  cervical 
cancer  would  limit  it  further.  Nevertheless, 
whatever  the  scope,  as  long  as  the  focus  is  on  a 
health  problem,  the  study  can  focus  on  alterna- 
tive means  to  solve  the  problem  or,  conversely, 
to  increase  health  status.  Some  studies,  how- 
ever, must  necessarily  focus  on  the  efficient  use 
of  a  technology.  This  is  particularly  true  of 
diagnostic  technologies,  where  the  ultimate 
health  problem  may  be  far  removed  from  the 
use  of  the  technology. 

2.  State  Objectives 

The  objectives  of  the  technology  being  as- 
sessed should  be  explicitly  stated,  and  the  analy- 
sis should  address  the  degree  to  which  the  objec- 
tives are  (expected  to  be)  met.  In  general,  the  ob- 
jectives will  be  governed  by  the  way  in  which 


the  problem  is  defined:  The  broader  the  problem 
definition,  the  broader  the  objectives.  Ordinari- 
ly, it  is  most  relevant  for  the  objectives  to  be  in 
terms  of  lowering  morbidity,  disability,  or  mor- 
tality or,  alternatively,  increasing  well-being. 
When  the  objectives  are  stated  in  terms  of  de- 
creasing costs,  the  relationship  between  costs 
and  health  benefits  is  often  lost,  sometimes  re- 
sulting in  untenable  assumptions  of  equal  effi- 
cacy across  treatment  modalities.  Often,  objec- 
tives are  stated  in  terms  of  achieving  a  certain 
level  of  benefit  for  the  least  cost,  or,  conversely, 
achieving  the  most  benefit  per  dollar  cost. 

3.  Identify  Alternatives 

Alternative  means  (technologies)  to  accom- 
plish the  objectives  should  be  identified  and  sub- 
jected to  analysis.  The  number  of  alternatives 
and  the  relevancy  of  the  analysis  will  increase  as 
the  scope  of  the  identified  problem  is  increased. 
Whereas  there  are  numerous  means  to  lower 
death  rates,  for  example,  there  are  relatively 
fewer  ways  to  lower  deaths  due  to  a  specific 
disease,  and  even  fewer  ways  to  do  this  by  em- 
ploying a  particular  technology.  One  of  the 
most  difficult  questions  to  answer  in  analyzing 
the  cost  effectiveness  of  a  given  intervention 
(such  as  Pap  screening)  is  "cost  effective  com- 
pared to  what?" 

4.  Analyze  Benefits/Effectiveness 

All  foreseeable  benefits /effectiveness  should 
be  identified,  and  when  possible  should  be 
measured.  The  relevant  benefits /effectiveness  of 
health  care  technology  in  the  health  field  often 
follow  directly  from  the  problem  under  consid- 
eration, the  objectives  specified,  and  the  frame- 
work in  which  the  problem  is  approached.  Not 
all  benefits /effectiveness  are  positive — some 
may  be  negative  (e.g.,  deaths  due  to  surgery) 
and  some  may  be  indeterminate  (e.g.,  incurable 
disease  may  be  discovered).  Each  of  the  follow- 
ing categories  should  be  considered:  1)  personal 
benefits/effectiveness,  such  as  alleviated  pain, 
reduced  risk  of  sickness  or  death,  enhanced 
quality  of  life,  lowered  anxiety,  2)  health  re- 
source benefits/effectiveness  such  as  increases 
and  decreases  in  health  care  expenditures,  3) 
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other  economic  benefits/effectiveness  such  as 
increased  productivity,  and  4)  social  benefits/ 
effectiveness  such  as  the  equitable  distribution 
of  medical  care.  When  possible,  and  if  agree- 
ment can  be  reached,  it  is  helpful  to  value  ben- 
efits in  common  terms  in  order  to  make  compar- 
isons across  alternative  programs  easier. 

5.  Analyze  Costs 

All  expected  costs  should  be  identified,  and 
when  possible  should  be  measured  in  dollars.  In 
general,  the  concept  of  "opportunity  cost"  is  the 
most  correct  way  to  consider  the  costs  of  a  pro- 
gram. That  is,  the  costs  are  equal  to  the  value  of 
the  opportunities  which  are  forgone  because  of 
the  investment  in  the  program. 

6.  Differentiate  Perspective  of  Analysis 

When  private  benefits  and  costs  differ  sub- 
stantially from  social  benefits  and  costs,  and  if  a 
private  perspective  is  appropriate  for  the  analy- 
sis, the  differences  should  be  identified.  Al- 
though CEA/CBA  is  generally  considered  a  tool 
of  social  policy,  it  is  helpful  and  important  to 
recognize  that  private  incentives  differ  from 
public  incentives  and  since  health  care  delivery 
is  often  funded,  always  demanded,  and  usually 
delivered  by  the  private  sector,  its  (the  private 
sector's)  perspective  may  be  very  important  to 
the  relevancy  of  the  analysis.  For  instance,  the 
social  benefits  of  elective  procedures  such  as 
elective  hysterectomy,  cancer  screening,  and 
many  psychotherapy  programs  are  apt  to  differ 
markedly  from  the  private  benefits.  Typically,  a 
CEA  will  identify  the  "social"  benefits  in  terms 
of  cost  reduction,  whereas  the  primary  private 
objective  (i.e.,  expected  benefits)  of  the  patient 
may  be  decreased  anxiety. 

7.  Perform  Discounting 

All  future  costs  and  benefits  should  be  dis- 
counted to  their  present  value  in  order  for  them 
to  be  compared  with  one  another.  Discounting 
can  be  thought  of  as  a  reverse  interest  rate.  It  is 
used  to  take  into  account  phenomena  such  as 
the  observation  that,  all  things  being  equal,  peo- 
ple prefer  benefits  (including  health  benefits) 


today  rather  than  at  a  future  time.  Although 
there  is  no  firm  agreement  as  to  the  precise  dis- 
count rate  to  use,  if  future  benefits  of  alternative 
programs  are  roughly  proportionate  to  one 
another,  the  rate  which  is  chosen  makes  little 
difference  to  the  outcome  of  the  analysis. 

8.  Analyze  Uncertainties 

Key  variables  should  be  analyzed  as  to  the 
importance  of  their  uncertainty  to  the  results  of 
the  analysis.  That  is,  a  "sensitivity  analysis" 
should  be  performed.  In  its  simplest  form  sensi- 
tivity analysis  is  nothing  more  nor  less  than  the 
application  of  common  sense  when  one  is  not 
sure  of  a  fact:  It  is  the  examination  of  the  uncer- 
tain event  under  different  assumptions.  Sensi- 
tivity analysis  can  indicate  both  when  more  in- 
formation is  needed  and  when  insufficient  infor- 
mation is  irrelevant. 

9.  Address  Ethical  Issues 

Ethical  issues  should  be  identified,  discussed, 
and  placed  in  appropriate  perspective  relative  to 
the  rest  of  the  analysis  and  the  objectives  of  the 
technology.  Many  health  care  programs  have  as 
their  primary  objective  the  equitable  distribu- 
tion of  services;  other  programs  include  it  as  one 
of  many  objectives;  still  other  programs  affect 
the  distribution  of  society's  goods  and  services 
without  an  explicit  intention  to  do  so.  A  CEA/ 
CBA  should  identify  all  these  effects.  When  pos- 
sible, it  should  also  measure  them.  Although 
such  effects  cannot  ordinarily  be  valued,  how- 
ever, they  are  often  germane,  and  sometimes 
essential,  to  the  measure  of  worth  of  a  health 
program. 

10.  Interpret  Results 

The  results  of  the  analysis  should  be  discussed 
in  terms  of  validity,  sensitivity  to  changes  in 
assumptions,  and  implications  for  policymaking 
or  decisionmaking.  This  is  important  both  be- 
cause the  intended  audience  is  often  a  public 
official  or  a  health  care  professional,  neither  of 
whom  may  be  technically  oriented,  and  because 
study  findings  are  often  reported  in  capsule 
form  such  as  a  news  brief,  and  are  often  intro- 
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duced  in  the  professional  literature  in  abstract 
form.  Results  of  CEA/CBA  often  have  the  po- 


OTHER  FINDINGS 

In  addition  to  conforming  to  the  aforemen- 
tioned 10  principles,  all  quantitative  analyses 
should  specify  data  sources,  be  written  as  clear- 
ly and  as  nontechnically  as  possible,  and  be  sub- 
jected to  peer  and  other  types  of  review,  includ- 
ing public  scrutiny  when  appropriate,  especially 
regarding  assumptions  upon  which  the  outcome 
of  the  analyses  may  rest.  In  general,  the  more 
technical  the  analysis,  the  more  important  that 
the  review  be  formalized  and  conducted  by  indi- 
viduals who  can  challenge  the  methodology  that 
is  employed.  Reviews  of  those  CEA/CBAs  that 
are  not  too  technical,  however,  may  facilitate 
public  scrutiny  regarding  the  validity  and,  espe- 
cially, the  appropriateness  of  key  assumptions. 
Such  scrutiny  may  be  useful  because  the  appli- 
cation of  CEA/CBA  in  the  field  of  health  policy 
is  only  part  of  a  larger  political  process. 

Since  this  report  is  primarily  designed  to  ex- 
amine the  policy  implications  of  using  CEA/ 
CBA  for  health  care  resource  allocation  deci- 
sions, the  methodological  process  which  is  envi- 
sioned is  substantially  different  from  what 
would  be  discussed  if  this  report  were  being 
written  for  the  academic  research  community. 

It  is  necessary  to  make  this  distinction  be- 
cause CEA/CBA  can  be  a  very  complex  under- 
taking analytically  and  often  requires  a  massive 
data  gathering  effort.  For  instance,  disease  pro- 
gression transition  rates  must  often  be  assigned 
and  mathematical  models  must  capture  the  dy- 
namics of  the  process;  the  effects  of  medical  in- 
tervention may  need  to  be  estimated  by  profes- 
sional opinion  or  empirically  evaluated  through 
epidemiological  observation  or  by  formal  clini- 
cal trials;  joint  production  costs  may  need  to  be 
estimated  using  sophisticated  dynamic  pro- 
graming techniques;  and  so  forth.  All  this  is  ex- 
pensive, time  consuming,  and  apt  to  require 
very  specialized  computer  support,  analytical 
skills,  and  clinical  judgment.  On  the  other  hand, 
the  real  world  dictates  that  health  resource 
allocation  decisions  must  often  be  made  without 


tential  to  mislead  the  reader,  a  hazard  which  can 
be  greatly  reduced  by  proper  interpretation. 


the  benefit  of  such  resources — that  is,  with  little 
time,  money,  and  technical  expertise.  These 
suboptimal  conditions,  however,  do  not  relieve 
decisionmakers  from  the  responsibility  of 
weighing  the  consequences  of  decisions. 

Since  CEA/CBA  is  being  spoken  of  or  advo- 
cated as  a  mechanism  to  assist  policymakers  in 
making  rational  choices  between  competing  ob- 
jectives, OTA  was  asked  to  assess  the  technique 
for  that  purpose.  The  findings  are  that,  as  for- 
mally applied,  the  methodology  could  often  be 
too  complex,  expensive,  and  time  consuming  if 
used  as  a  routine  method  for  decisions  by  public 
policymakers.  In  fact,  the  cost-effectiveness  case 
studies  conducted  as  part  of  this  assessment1 
serve  to  highlight  the  immaturity  of  the  tech- 
nique itself.  Initial  drafts  of  more  than  half  of 
the  studies,  all  of  which  were  performed  by  re- 
spected health  care  researchers,  were  considered 
by  reviewers  to  be  inadequate  with  respect  to 
the  relevancy/usefulness  of  the  results,  the 
validity  of  the  methodology,  the  tenuousness 
(or  error)  in  the  key  assumptions,  and/or  the 
validity  of  the  data  used.  Clearly,  the  field  is  not 
yet  fully  defined. 

Nevertheless,  the  logic  behind  using  CEA/ 
CBA,  even  at  an  operational  or  policymaking 
level,  appears  sufficient  to  suggest  that  the 
10  principles  previously  enumerated  can  and 
should  be  followed  under  most  circumstances. 

In  no  way,  however,  does  this  finding  suggest 
that  a  complete  analysis  is  either  easy  or  unnec- 
essary. There  is  clearly  a  need  for  ongoing  and 
sophisticated  studies  of  the  cost  effectiveness  of 
specific  technologies  as  well  as  a  need  for  ad- 
vancing the  state  of  the  art  itself.  For  instance, 
much  good  research  has  been  done  in  develop- 
ing and  testing  a  composite  index  which  de- 

^ee  Background  Paper  #2:  Case  Studies  of  Medical  Technol- 
ogies, Background  Paper  #3:  The  Efficacy  and  Cost  Effectiveness 
of  Psychotherapy,  and  Background  Paper  #5;  Assessment  of  Four 
Common  X-Ray  Procedures,  prepared  by  OTA  in  conjunction 
with  this  assessment. 
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scribes  the  health  status  of  a  population  at  any 
given  point  in  time  (e.g.,  707,711,731,732,733). 
That  type  of  work  should  continue  and  perhaps 
should  receive  more  emphasis.  Nevertheless  for- 
mal CEA/CBAs,  however  valid  and  effective 
potentially,  can  be  inappropriately  used  by  de- 
cisionmakers who  lack  the  necessary  resources, 


skills,  or  understanding  of  the  inherent  limita- 
tions. Defining  a  more  practical,  limited  ap- 
proach to  the  methodology  seems  clearly  appro- 
priate and  does  not  diminish  the  worth  of,  or 
need  for,  more  sophisticated  approaches  under 
different  circumstances. 


NONAGGREGATED  ANALYSIS— AN  ARRAYING  TECHNIQUE 


Since  many  of  the  methodological  weaknesses 
of  CEA/CBA  may  be  hidden,  aggravated,  or  in 
fact  caused  by  the  practice  of  deriving  a  cost- 
benefit  or  cost-effectiveness  ratio — that  is,  a 
numerical  bottom  line — the  possibility  of  not 
aggregating  the  often  complex  sets  of  calcula- 
tions should  be  investigated  and  considered. 
Rather  than  aggregating,  analysts  might  ex- 
plicitly list  or  ARRAY  all  the  elements  which  are 
included  in,  or  would  be  affected  by,  decisions. 
When  costs  and  effectiveness  could  be  quanti- 
fied, that  would  be  done;  when  they  could  be 
combined,  that  would  also  be  done.  Whenever 
one  or  more  important  nonquantifiable  varia- 
bles would  otherwise  either  be  left  out  or  be  rele- 


gated to  a  footnote,  however,  no  effort  to  arrive 
at  a  single  combined  benefit  value  would  be 
made.  A  nonaggregated  or  array  method  of 
analysis  would  give  decisionmakers  a  greater 
number  of  elements  to  consider,  but  it  would 
also  make  intangible  or  nonquantifiable  factors 
more  explicit,  and  thus  might  also  help  force 
consideration  of  those  factors  by  decisionmak- 
ers commensurate  with  the  factors'  significance. 
The  arraying  method  can  either  be  highly  quan- 
titative and  analytical,  using  multiobjective  pro- 
graming techniques,  or  when  that  is  not  desir- 
able or  possible,  it  can  be  presented  more  quali- 
tatively. 
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Appendix  A.— Analysis  of  the  Growth  and  Composition 

of  the  Health  Care  CEA/CBA  Literature 


As  measured  by  contributions  to  the  professional 
literature,  interest  in  health  care  applications  of  CEA 
and  CBA  has  grown  dramatically  over  the  past  dec- 
ade. This  appendix  analyzes  the  extent  and  nature  of 
the  growth  in  this  literature  and  examines  its  substan- 
tive content.  An  assessment  of  the  quality  of  contri- 
butions to  the  literature  was  presented  in  chapter  3. 

The  method  of  the  analysis  of  the  growth  and  com- 
position of  the  health  care  CEA/CBA  literature  that 
appears  in  this  appendix  is  described  in  the  first  sec- 
tion below.  The  second  section  offers  an  empirical 
characterization  of  the  magnitude  and  nature  of  the 
literature,  examining  the  diffusion  over  time  of 
health  care  CEA  CBA  interest  in  several  dimensions: 
numbers  of  publications;  the  mix  of  medical  and  non- 
medical publication  vehicles;  relative  preferences  for 
CEA  and  CBA;  medical  functions  emphasized;  physi- 
cal nature  of  subjects  of  study;  and  the  decision  ori- 
entation of  analyses.  Specific  substantive  topics  and 
areas  of  interest  which  have  dominated  the  attention 
of  authors  were  analyzed  in  chapter  1.  The  material 
covered  by  that  review  accounts  for  roughly  half  of 
all  the  entries  in  the  bibliography  in  appendix  B.  That 
section  of  chapter  1,  therefore,  should  be  regarded  as 
part  of  this  analysis. 

Method 

The  empirical  analysis  in  this  appendix  derives 
from  counts  and  classifications  of  over  500  of  the  ref- 
erences in  the  bibliography  of  CEA  and  CBA  in 
health  care  (app.  B).  With  a  few  exceptions,  the  bibli- 
ography consists  of  references  from  the  years  1966 
through  1978,  including  CBAs  and  CEAs  concerning 
personal  health  services,  reviews  and  comments  on 
such  literature,  and  discussions  of  CEA/CBA  meth- 
odology directed  specifically  to  health  care  profes- 
sionals. Appendix  B  includes  a  description  of  the  bib- 
liography's contents,  rules  for  inclusion  or  exclusion 
of  references,  and  the  literature  search  process. 

Each  reference  from  the  years  1966  through  1978 
was  classified  according  to  the  following  dimensions: 

1.  year  (1966-78); 

2.  type  of  analysis  (CBA,  CEA,  general  or  un- 
known); 

3.  publication  vehicle  (medical  journal;  journal 
intended  primarily  for  nonphysician  health 
professionals,  administrators,  or  health  serv- 
ices researchers;  nonhealth); 

4.  medical  function  of  the  program  or  technology 
(prevention;  diagnosis;  treatment,  divided  into 
cure,  rehabilitation,  maintenance,  or  pallia- 


tion; administration;  some  or  all  of  the  above 
or  unknown); 

5.  physical  nature  of  the  program  or  technology 
(technique,  drug,  procedure,  equipment,  per- 
sonnel, system,  some  or  all  of  the  above  or  un- 
known); 

6.  decision  orientation  (i.e.,  whose  decision?  indi- 
vidual, organization,  society,  unknown);  and 

7.  subject  matter  (a  specific  program  or  technol- 
ogy, review  article,  methodology,  combina- 
tions of  these). 

Classification  involved  numerous  arbitrary  judg- 
ments. Many  of  the  assignments  depended  on  the 
content  of  abstracts  or  even  the  wording  of  titles. 
Where  available  information  suggested  that  each  of 
two  (and  very  occasionally  three)  categories  was  ap- 
propriate, half  (or  a  third)  credit  was  assigned  to 
each.  For  example,  in  the  "medical  function"  dimen- 
sion, certain  screening  programs  were  recorded  as 
half  prevention  and  half  diagnosis.  (A  comprehen- 
sive blood  pressure  control  program  was  counted  as 
one-third  for  each  of  prevention,  diagnosis,  and 
treatment.)  For  "type  of  analysis,"  a  few  studies 
presented  both  cost-benefit  and  cost-effectiveness 
estimates.  Accordingly,  these  were  scored  as  one-half 
CBA  and  one-half  CEA.  The  "unknown"  or  "other" 
categories  were  used  liberally  when  it  was  difficult  or 
impossible  to  categorize  references  accurately. 

Although  the  possibility  remains  that  many  of  the 
assignings  were  not  optimal,  OTA  is  unaware  of  any 
significant  sources  of  bias.  Thus,  at  a  minimum  the 
quantitative  analysis  should  provide  an  accurate 
qualitative  characterization  of  the  size,  nature,  and 
contents  of  the  literature. 

Growth  and  Character  of  the  Literature 

Diffusion 

The  magnitude  and  rate  of  growth  of  the  health 
care  CEA/CBA  literature  are  indicated  in  table  A-l 
end  figure  A-l.  Table  A-l  records  the  annual  num- 
bers of  CEAs,  CBAs,  and  related  publications  for  the 
years  1966  through  1978.  The  annual  sum  of  identifi- 
able CEAs  and  CBAs  (column  3)  is  plotted  in  figure 
A-l,  as  is  the  total  of  all  CEA/CBA-relevant  refer- 
ences (column  5). 

As  the  data  vividly  demonstrate,  widespread  inter- 
est in  health  care  CEA/CBA  is  a  phenomenon  of  the 
1970s.  Prior  to  1970,  the  annual  number  of  health 
care  CEA/ CBAs  and  related  publications  never  ex- 
ceeded 16;  after  1970,  the  number  was  never  less  than 
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Table  A-1.— Numbers  of  Health  Care  CEA/CBAs  by  Year(1966-78) 


CBAsa 

CEAsb 

CBAs  +  CEAs 

Otherc 

Total 

Year 

(1) 

(2) 

(3)  =  (1)  +  (2) 

(4) 

(5)  =  (3)  +  (4) 

iybb  

4.0 

U.o 

0 

U 

c 
0 

1967   

4.U 

1  .U 

c 
0 

U 

c 

0 

1968   

0.0 

4.0 

1  1 

A 

4 

lo 

1969  ....... 

£..0 

1 .0 

A 

4 

o 

0 

1Q70 

3  0 

9.0 

12 

4 

16 

1971  

9.5 

10.5 

20 

5 

25 

1972   

14.5 

5.5 

20 

7 

27 

1973  

25.5 

16.5 

42 

2 

44 

1974^   

19.0 

17.5 

36.5 

7 

43.5 

1975d   

17.0 

21.5 

38.5 

13 

51.5 

1976  

40.5 

36.5 

77 

15 

92 

1977   

31.5 

47.5 

79 

23 

102 

1978  

33.0 

38.0 

71 

22 

93 

Total  

211.0 

210.0 

421.0 

104 

525.0 

aAII  papers  identified  as  CBAs  in  title  or  otherwise  known.  0.5  indicates  half  CEA  and  half  CBA. 
^All  papers  identified  as  CEAs  in  title  or  otherwise  known.  0.5  indicates  half  CEA  and  half  CBA. 
°AII  other  papers,  including  those  the  title  of  which  does  not  state  CEA  or  CBA;  also  general  methodology  papers,  etc. 
^Fractional  entries  for  1974  and  1975  reflect  the  inclusion  of  one  article  that  appeared  in  a  journal  with  publication  date 
December  1974/January  1975. 

SOURCE:  Office  of  Technology  Assessment. 


25.  The  two  curves  in  figure  A-1  exhibit  the  charac- 
teristics of  the  classic  diffusion  process  (759),  with 
"take-off"  occurring  around  1970  and  diffusion  pro- 
ceeding at  an  almost  exponential  rate  throughout  the 
decade.  The  nature  of  the  data  is  such  that  it  is  im- 
possible to  tell  whether  the  curves  have  reached  an 
"inflection  point,"  a  point  beyond  which  growth  in 
the  literature  will  proceed  at  a  progressively  slower 
rate.1 

The  proliferation  of  professional  journals  might  be 
expected  to  result  in  increased  numbers  of  publica- 
tions on  many  subjects,  without  representing  a  genu- 
ine increase  in  relative  interest  in  the  subject.  To  pro- 
vide perspective,  one  can  compare  the  growth  in  the 
health  care  CEA/CBA  literature  with  that  of  the 
overall  number  of  citations  in  Index  Medicus.  Over 
the  entire  period  studied  (through  1977,  since  1978 
was  not  yet  completed  when  the  data  were  acquired) 
Index  Medicus  citations  increased  from  157,000  to 
260,000  articles,  a  growth  of  two-thirds  (66  percent). 
By  comparison,  the  CEA/CBA  literature  grew  by  a 
factor  of  from  14  to  20  (using  column  3)  and  column 
5  data  from  table  A-1,  respectively).  Even  in  very  re- 
cent years,  growth  in  the  latter  considerably  outpaces 
that  of  the  overall  medical  literature.  For  example, 
from  1975  to  1977,  the  number  of  contributions  to 
the  CEA/CBA  literature  doubled,  while  Index  Medi- 
cus citations  rose  less  than  10  percent.  Clearly,  the 

■The  count  of  papers  revealed  slightly  fewer  for  1978  than  for  1977,  and 
growth  in  the  number  of  papers  in  1977  was  relatively  little  compared  to 
that  in  1976.  An  inflection  point  may  have  been  reached.  Barring  any 
changes  in  the  "environment,"  continued  diffusion  may  be  gradual.  As 
observed  immediately  below,  however,  the  "environment"  is  changing  in 
significant  ways  which  may  very  well  accelerate  diffusion. 


rate  of  growth  of  the  health  care  CEA/CBA  literature 
vastly  exceeds  that  of  the  medical  literature  in  gen- 
eral. 

The  usual  "mechanics"  of  a  diffusion  process  sug- 
gest continued  growth  in  the  number  of  publications, 
but  this  general  tendency  should  be  reinforced  in  the 
early  1980's  by  several  influences  in  the  health  care 
environment:  Establishment  of  the  National  Center 
for  Health  Care  Technology,  with  its  authority  to 
assess  the  safety,  efficacy,  and  cost  implications  of 
medical  technologies  should  foster  analytical  activi- 
ty; publicity  associated  with  other  governmental  ef- 
forts should  increase  awareness  and  interest;  a  simi- 
lar effect  can  be  anticipated  to  follow  activities  with- 
in the  medical  profession,  such  as  the  AMA's  Resi- 
dent Physicians  Section's  recent  publication  of  its  re- 
port on  cost-effective  care;  growth  in  attention  to 
health  economics  issues  in  medical  school  curricula 
should  promote  interest  and  understanding  among 
young  physicians;  and  most  generally,  but  probably 
most  importantly,  continued  concern  about  the  high 
and  growing  costs  of  care  should  itself  generate 
numerous  attempts  to  assess  the  cost  effectiveness  of 
medical  technologies  (703). 

Publication  Vehicles 

Table  A-2  shows  the  distribution  by  year  of  the 
health  care  CEA/CBA  literature  by  type  of  publica- 
tion. The  purpose  is  to  examine  what  proportion  of 
the  literature  has  been  intended  primarily  for  a  physi- 
cian audience,  as  reflected  in  publication  in  medical 
journals,  and  how  this  proportion  has  changed  over 
time. 
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Figure  A-1.  —  Diffusion  of  Health  Care  CEA/CBAs  by  Year(1966-77) 
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1966        1967        1968       1969        1970        1971        1972        1973        1974        1975       1976  1977 


Year 

Key:  — — ^—  Number  ol  CEAs  +  CBAs  per  year,  from  column  3  of  table  A-2.  app-  A 

—  —  —  CEAs  +  CBAs  +  related  papers  per  year,  from  column  5  of  table  A-2.  app.  A 

SOURCE:  Office  of  Technology  Assessment 


67-774  0-80-6 


74  •  Background  Paper  #2:  Methodological  Issues  and  Literature  Review 


Table  A-2.— Numbers  of  Health  Care  CEA/CBAs  by 
Type  of  Journal  and  Year  (1966-78) 


Number  of  CEA/CBAs  by  type  of  journal 


Medical 

Nonmedical0 

journals3 

NEJMb 

journals 

Otherd 

Total 

Year 

(D 

(2) 

(3) 

(4) 

(5)  =  (1)  +  (3)  +(4) 

1966 

0 

0 

1 

4 

5 

1967   

0 

0 

1 

4 

5 

1968  

4 

2 

6 

5 

15 

1969   

2 

1 

2 

2 

6 

1970   

4 

1 

6 

6 

16 

1971  

10 

0 

7 

8 

25 

1972   

6 

0 

15 

6 

27 

1973  

11 

1 

19 

14 

44 

1974e   

23 

1 

7.5 

13 

43.5 

1975e   

20 

7 

15.5 

16 

51.5 

1976   

44 

5 

30 

18 

92 

1977  

44 

5 

27 

31 

102 

1978   

42 

8 

25 

26 

93 

Total 

211.0 

31 

162.0 

153 

525.0 

aJournals  read  primarily  by  physicians.  Excludes  nursing,  dental,  public  health,  hospital  journals,  etc.  Includes  psychiatric 
journals. 

b/Vew  England  Journal  of  Medicine. 

CAII  other  journals.  Includes  non-physician-oriented  health  journals,  economics  journals,  policy  analysis  journals,  etc. 
dBooks,  chapters  in  books,  unpublished  papers,  etc. 

fractional  entries  tor  1974  and  1975  reflect  the  inclusion  of  one  article  that  appeared  in  a  journal  with  publication  date 
December  1974/January  1975. 

SOURCE:  Office  of  Technology  Assessment. 


Figure  A-2  plots  columns  1  and  3  of  table  A-2  to  il- 
lustrate the  diffusion  paths  of  medical  and  nonmedi- 
cal journal  articles.  Although  the  paths  follow  each 
other  closely,  the  graph  shows  a  shift  from  a  rough 
parity  prior  to  1973  to  a  clear  majority  of  medical 
journal  articles  after  1973.  In  other  words,  the  rate  of 
growth  of  the  medical  literature  has  exceeded  that  of 
the  nonmedical  journal  literature,  particularly  in  re- 
cent years.  This  shift  is  clearly  suggestive  of  a  grow- 
ing economic  consciousness  in  the  medical  profes- 
sion. 

Column  2  in  table  A-2  records  the  annual  number 
of  CEA/CBA  articles  in  the  New  England  Journal  of 
Medicine  (NEJM).  Several  of  the  best,  most  influen- 
tial health  care  CEA/CBAs  have  been  published  in 
NEJM  (see  ch.  3),  hence  its  isolation  here.  It  is  inter- 
esting to  observe  that  prior  to  1975,  the  number  of 
CEA/CBA-relevant  contributions  in  NEJM  exceeded 
one  only  once  (in  1968).  NEJM  has  published  several 
relevant  articles  each  year  since  1975.  Some  observ- 
ers believe  that  medical  interest  in  CEA/CBA  re- 
ceived its  biggest  boost  from  publication  of  the  con- 
troversial July  31,  1975,  issue  of  NEJM  which  was  de- 
voted to  CEA/CBA  studies  and  discussions  of  their 
methodology  and  usefulness.  (See  the  methodology 
review  article  section  of  ch.  3.) 

Mix  of  CEAs  and  CBAs 


Prior  to  the  most  recent  years,  the  annual  number  of 
CBAs  generally  exceeded  the  number  of  CEAs.  Since 
1975,  the  reverse  has  been  true,  supporting  the  state- 
ment in  a  recent  review  by  Weinstein  that  CEA  "has 
been  gaining  in  acceptance  relative  to  benefit-cost" 
(569).  The  reason  is  not  obvious.  Weinstein  attrib- 
utes the  shift  to  "the  conceptual  limitations  of  the 
(human  capital)  approach  and  the  empirical  barriers 
to  the  willingness-to-pay  approach."  Complemen- 
tary or  alternative  explanations  relate  to  the  apparent 
relative  conceptual  simplicity  of  CEA:  Analysts  use 
CEA  because  it  is  easier  for  the  economic  layper- 
son— e.g.,  the  physician — to  understand;  also,  the 
recent  relative  growth  in  the  literature  in  medical 
journals  appears  to  include  relatively  more  contribu- 
tions by  physicians,  who,  as  economic  laypersons, 
may  find  CEA  easier  to  perform  than  CBA.2  Econo- 
mists' traditional  preference  (at  least  in  nonhealth 
care  areas)  for  CBA  may  reflect  a  general  conceptual 
bent  toward  valuing  and  directly  comparing  the  posi- 
tive and  negative  consequences  of  activities.  It  also 
probably  reflects  the  successful  use  of  CBA  in  early 
applications  in  which  benefits  were  reasonably  amen- 
able to  monetary  valuation  (e.g.,  water  resource 
management). 


Columns  1  and  2  of  table  A-l  distinguish  analyses 
identified  as  CBAs  from  those  identified  as  CEAs. 


2The  observation  that  physicians  are  making  relatively  more  contribu- 
tions to  the  literature  in  recent  years  is  based  on  an  impression.  No  attempt 
was  made  to  formally  categorize  authors  by  degree  or  profession. 
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Key;   CEAs  and  CBAs  in  medical  journals,  per  year  (from  column  1,  table  A-3.  app.  A) 

—  —  —  CEAs  and  CBAs  in  nonmedical  health  care  journals,  per  year  (from  column  3.  table  A-3.  app.  A) 
SOURCE:  Office  of  Technology  Assessment. 
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Medical  Functions 

Tables  A-3  and  A-4  present  categorizations  of  liter- 
ature contributions  by  the  general  medical  function 
which  is  the  substantive  focus  of  each  paper.  Table 
A-3  includes  three  broad  categories  (prevention,  di- 
agnosis, and  treatment,  plus  a  fourth  miscellaneous 
category).  Table  A-4  breaks  down  treatment  func- 
tions by  their  purpose:  cure,  rehabilitation,  mainte- 
nance, or  palliation. 

Among  the  three  broad  categories,  prevention  and 
diagnosis  each  account  for  more  than  a  quarter  of  the 
studies  over  the  entire  period,  while  the  various  types 


Table  A-3.— Numbers  of  Health  Care  CEA/CBAs  by 
Medical  Function  and  Year  (1966-78) 


Number  of  CEA/CBAs  by  medical  function 


Prevention 

Diagnosis 

Treatment 

Other3 

Year 

(D 

(2) 

(3) 

(4) 

1966  

0.0 

0.0 

0.0 

5 

1967  

0.0 

0.3 

1.7 

3 

1968  

2.5 

3.0 

3.5 

6 

1969  

1.5 

0.5 

2.0 

2 

1970  

3.0 

2.0 

3.0 

8 

1971  

6.5 

3.5 

4.0 

11 

1972  

7.0 

2.0 

4.0 

14 

1973  

14.5 

4.0 

10.5 

15 

1974  

2.5 

5.0 

14.0 

22 

1975  

5.0 

10.0 

14.5 

22 

1976  

15.0 

16.0 

28.0 

33 

1977  

12.5 

17.0 

37.5 

35 

1978  

18.0 

25.5 

18.5 

31 

Total 

88.0 

88.8 

141.2 

207 

includes  mixes  of  all  three  functions  (prevention,  diagnosis,  and  treatment),  administration,  general,  and  unknown. 

SOURCE:  Office  of  Technology  Assessment. 

Table  A-4.— Numbers  of  Health  Care  CEA/CBAs  by 

Treatment  Function  and  Year  (1966-78) 

Number  of  CEA/CBAs  by  treatment  function 

Cure        Rehabilitation  Maintenance 

Palliation 

Total 

Year 

(D  (2) 

(3) 

(4)        (5)  = 

(1)  +  (2)  +  (3)  +  (4) 

1966   

0.0  0.0 

0.0 

0 

0.0 

1967   

1.3  0.3 

0.0 

0 

1.7 

1968   

1.0  1.0 

1.5 

0 

3.5 

1969   

1.5  0.0 

0.5 

0 

2.0 

1970   

0.5  1.0 

1.5 

0 

3.0 

1971  

2.0  1.0 

1.0 

0 

4.0 

1972   

2.5  1.5 

0.0 

0 

4.0 

1973   

4.5  3.5 

2.5 

0 

10.5 

1974   

5.0  7.5 

1.5 

0 

14.0 

1975   

6.5  3.0 

5.0 

0 

14.5 

1976   

10.5  6.5 

11.0 

0 

28.0 

1977   

25.0  4.5 

8.0 

0 

37.5 

1978   

8.5  4.0 

6.0 

0 

18.5 

Total 

68.8  33.8 

38.5 

0 

141.2 

SOURCE:  Office  of  Technology  Assessment. 

of  treatment  total  just  under  half.3  If  one  divides  the 
years  covered  into  the  period  preceding  1974  and  the 
period  from  1974  through  1978,  however,  there  is  a 
significant  shift  in  the  relative  mix,  away  from  pre- 
vention and  toward  diagnosis  and  treatment.  During 
the  most  recent  5  years,  the  numbers  of  both  diagno- 
sis- and  treatment-oriented  papers  have  exceeded  the 
pre-1974  totals  by  a  factor  of  four  or  five.  By  con- 


3In  this  recent  review,  Weinstein  (569)  observed:  "Diagnostic  procedures, 
apart  from  screening  tests,  have  received  little  attention."  This  OTA  anal- 
ysis' attribution  of  nearly  a  quarter  of  the  codable  literature  to  diagnosis  is 
not  necessarily  at  variance  with  this  observation,  since  it  includes  many 
screening  programs  in  the  diagnosis  category. 
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trast,  the  number  of  prevention-oriented  contribu- 
tions is  only  50  percent  greater  than  that  of  the  earlier 
period  (see  table  A-3). 

This  shift  seems  consistent  with  the  relative  growth 
in  the  medical  journal  share  of  the  literature,  assum- 
ing that  physicians  are  relatively  more  interested  in 
diagnosis  and  treatment,  as  opposed  to  prevention, 
than  are  nonphysician  health  professionals  (including 
both  providers  and  health  services  researchers). 
Also,  consistent  with  the  principal  early  nonhealth 
care  applications  of  CEA/CBA,  early  health  care 
CEA/CBAs  concentrated  relatively  more  on  health 
care  "public  goods,"  including  especially  communi- 
cable disease  control,  than  on  individual  patient  care, 
a  growing  concern  today.  Several  excellent  commu- 
nicable disease  prevention  studies  are  found  in  the  re- 
cent medical  literature,  but  this  is  one  of  the  few 
substantive  areas  in  which  the  number  of  pre-1974 
papers  actually  exceeded  the  number  of  1974  through 
1978.  (See  ch.  1.) 

The  shift  away  from  prevention  may  not  be  per- 
manent. The  widespread  perception  that  "technol- 
ogy" is  a  major  villain  in  medical  cost  inflation,  com- 
bined with  the  general  medical  orientation  toward 
diagnosis  and  treatment,  has  contributed  to  growing 
interest  in  diagnostic  and  treatment  technology,  both 
in  the  CEA/CBA  literature  and  in  individual  physi- 
cian decisionmaking  concerning  the  use  of  such  tech- 
nology. These  interests  will  likely  be  sustained  in  the 
near  future.  However,  the  Federal  Government's  re- 
cent emphasis  on  prevention  (743),  increasing  public 
acceptance  of  the  ideas  of  disease  prevention  and 
health  promotion,  and  the  conscious  linking  of  pre- 
vention to  cost  containment  (e.g.,  564)  may  promote 
renewed  interest  in  prevention-oriented  CEA/CBA. 

Table  A-4  shows  that  half  of  all  treatment-oriented 
papers  are  concerned  with  curative  treatments,  and 
the  remaining  half  are  divided  roughly  equally  be- 
tween medical  rehabilitation  and  maintenance.  Re- 
flecting the  inherent  subjectivity  and  difficulty  of 
quantifying  "pain  relief,"  "comfort,"  etc.,  the  lit- 
erature included  not  a  single  contribution  that  could 
be  identified  as  dealing  with  palliation.  The  relative 
mix  of  treatment  functions  has  not  changed  signifi- 
cantly in  recent  years.  Of  note  is  the  unusually  large 
number  of  cure-oriented  papers  in  1977. 

Physical  Nature  of  Subjects  of  Study 

Is  there  a  growing  emphasis  in  health  care  CEA/ 
CBA  on  individual  technologies?  OTA's  examination 
of  the  literature  permits  only  an  impressionistic  an- 
swer. In  attempting  to  categorize  subjects  by  their 
physical  nature,  OTA  was  incapable  of  definitively 
assessing  the  vast  majority  as  either  technique,  drug, 


procedure,  equipment,  personnel,  or  system.  Most 
seemed  to  represent  a  mix  of  two  or  more  categories; 
consequently,  they  were  included  in  the  "miscellane- 
ous" category.4  Even  some  which  could  be  catego- 
rized were  categorized  with  a  feeling  of  discomfort.  A 
study  of  the  cost  effectiveness  of  CT  scanning  ap- 
pears on  the  surface  to  belong  under  "equipment" 
(where  it  was  categorized),  yet  that  same  study  em- 
phasizes the  important  role  of  the  new  technicians 
needed  to  operate  the  scanner. 

A  principal  impression  is  that  the  literature  covers 
a  broad  spectrum  of  types  of  programs  and  technolo- 
gies, with  procedures  being  the  best  represented  cate- 
gory. In  recent  years,  there  appears  to  have  been  dis- 
tinct growth  in  the  attention  devoted  to  equipment- 
embodied  technologies,  with  CT  scanning  leading  the 
way  with  some  18  references  since  1975.  (See  ch.  1.) 

Decision  Orientation 

The  original  intent  of  CEA/CBA  was  to  assist  in 
social  decisionmaking,  i.e.,  to  identify  and  value  pro- 
gram costs  and  benefits  from  a  societal  perspective. 
Businesses  and  individuals  have  long  employed  the 
ideas  behind  CEA/CBA  to  grapple  with  decision 
problems,  but  the  CEA/CBA  label  seems  to  be  ap- 
plied with  increasing  frequency  to  analyses  whose 
decision-assisting  perspective  is  narrower  than  that 
of  "society." 

Table  A-5  permits  an  exploration  of  the  distribu- 
tion of  "decision  orientation"  in  the  health  care 
CEA/CBA  literature  and  of  changes  in  the  distribu- 
tion over  time.  The  table  suggests  that  the  social 
perspective  has  dominated  the  literature  over  the  en- 
tire period  studied,  accounting  for  roughly  70  percent 
of  all  publications  in  both  the  early  and  most  recent 
years;  if  anything,  its  dominance  has  grown  slightly 
over  time.  Nevertheless,  it  is  also  true  that  articles 
oriented  toward  individual  (e.g.,  practitioner)  deci- 
sionmaking have  increased  most  rapidly  in  recent 
years.  Comparing  the  pre-1974  period  with  the  years 
1974  through  1978,  one  observes  a  near  doubling  of 
the  share  of  papers  oriented  toward  the  individual 
perspective.  This  growth  has  come  at  the  expense  of 
papers  with  an  organizational  orientation.  While  the 
latter  two  categories  together  account  for  fewer  than 
30  percent  of  the  literature  contributions,  the  shift 
may  be  significant. 


■"In  no  year  did  OTA  manage  to  categorize  more  than  40  percent  of  the 
references  as  other  than  "miscellaneous,"  and  about  20  percent  was  typical. 
A  table  of  the  counts  is  not  presented,  because  the  mix  in  the  specific  cate- 
gories, based  on  so  few  observations,  is  not  necessarily  representative. 
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Table  A-5.— Numbers  of  Health  Care  CEA/CBAs  by 
Decision  Orientation  and  Year  (1966-78) 


Number  of  CEA/CBAs  by  decision  orientation 


Individual 

Organization 

Society 

Unknown 

Year 

(1) 

(2) 

(3) 

(4) 

1966  

0 

0 

3 

2 

1967  

0 

0 

5 

0 

1968  

0 

4 

9 

2 

1969  

0 

2 

2 

2 

1970  

1 

3 

7 

5 

1971  

4 

2 

14 

5 

1972  

2 

5 

12 

8 

1973  

2 

7 

27 

8 

1974a  

5.5 

2 

21 

15 

1975a  

2.5 

11 

24 

14 

1976  

12 

4 

49 

27 

1977  

13 

4 

50 

35 

1978  

8 

7 

50 

28 

Total  

50 

51 

273 

151 

aFractional  entries  for  1974  and  1975  reflect  the  inclusion  of  one  article  that  appeared  in  a  journal  with  publication  date 
December  1974/January  1975. 

SOURCE:  Office  of  Technology  Assessment. 


Summary 

Table  A-6  summarizes  highlights  of  this  empirical 
description  of  the  literature.  Breaking  the  period  into 
the  "early"  years  (those  prior  to  1974)  and  "recent" 

Table  A-6.— Overview  of  Trends  in  Health  Care 
CEA/CBA  Literature  (1966-73  and  1974-78)3 

1966-73  1974-78 


Average  annual  number  of  publications  .  18  76 

Publications  in  medical  journals  as 

percent  of  total  journal  publications .  .  39%  62% 

CEAs  as  percent  of  CEAs  +  CBAs   41  53 

Percent  of  articles  on: 

Prevention   44  22 

Diagnosis   19  31 

Treatment   36  47 

Percent  of  articles  with  orientation  of: 

Individual   8  16 

Organization   21  11 

Society   71  74 


years  (1974-78)  represents  an  arbitrary  decision 
based  on  observation  of  trends.  Nevertheless,  it  is  in- 
teresting to  note  that  this  dividing  line  (or  one  a  year 
earlier)  seemed  appropriate  for  all  of  the  phenomena 
of  interest.  No  explanation  is  offered  as  to  why  this 
was  the  case. 

As  the  table  indicates,  recent  years  have  witnessed 
dramatic  growth  in  the  number  of  contributions  to 
the  health  care  CEA/CBA  literature  (item  1).  More  of 
this  growth  has  occurred  in  medical  than  in  nonmedi- 
cal journals  (item  2),  and  CEA  is  gaining  favor  rela- 
tive to  CBA  (item  3).  The  early  prominence  of  studies 
with  a  substantive  prevention  theme  has  diminished, 
while  studies  related  to  diagnosis  and  treatment  have 
become  more  popular  (item  4).  Health  care  CEA/ 
CBAs  retain  as  their  principal  orientation  a  societal 
perspective  on  problems,  though  studies  with  an  in- 
dividual practitioner  orientation  are  becoming  in- 
creasingly common  (item  5). 


aAII  differences  significant  at  p  =  0.05. 
SOURCE:  Office  of  Technology  Assessment. 
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Contents  and  Development  of 
the  Bibliography 

The  bibliography  includes  approximately  600  ref- 
erences for  CEAs  and  CBAs  on  personal  health  serv- 
ices topics,  reviews  and  comments  on  such  literature, 
and  discussions  of  CEA/CBA  methodology  directed 
specifically  to  health  care  professionals.  It  is  intended 
to  be  as  comprehensive  as  possible  for  the  years  1966 
through  1978.  Given  the  lag  between  publication  and 
indexing  and  citation,  several  articles  and  books  pub- 
lished in  1978  may  have  been  missed.  Included  in  the 
bibliography  are  a  few  references  from  before  1966, 
several  from  1979,  and  a  few  from  1980,  though  no 
systematic  attempt  was  made  to  identify  references 
outside  of  the  1966-78  period.  Excluded  from  the  bib- 
liography are  scores  of  CEA/CBAs  on  health-rele- 
vant nonmedical  subjects  (e.g.,  traffic  safety  and 
control  of  environmental  pollution),  as  well  as  doz- 
ens of  books  and  articles  on  CEA/CBA  methodology 
that  are  addressed  to  a  general  nonhealth  technical 
audience  (e.g.,  737). 

The  line  determining  inclusion  in  or  exclusion  from 
the  bibliography  was  not  invariably  a  fine  one.  In 
general  for  methodology  articles,  borderline  refer- 
ences were  excluded.  Thus,  certain  prominent  articles 
which  have  had  substantial  impact  on  health  care 
CEA/CBA  are  not  found  in  the  bibliography  (though 
some  are  listed  in  "Other  References")  because  they 
were  not  necessarily  directed  at  a  health  care  audi- 
ence. The  seminal  work  of  Rice  on  measuring  the  cost 
of  illness  is  a  good  case  in  point  (721,746),  as  is  the 
related  work  of  Acton  and  others  on  measuring  the 
value  of  life  (4,470,  730,761).  These  studies  reside  at 
the  heart  of  a  long-lived  CEA/CBA  intellectual  de- 
bate, and  each  has  formed  the  basis  of  numerous  at- 
tempts to  value  the  health  benefits  of  programs;  but 
the  issues  and  techniques  transcend  categorization  as 
health  care  methodologies.  They  are  equally  relevant 
to  numerous  human  welfare  programs  outside  of  the 
personal  health  services  arena.  Similarly,  several  ex- 
cellent studies  of  the  social  costs  of  specific  illnesses 
are  excluded  because  they  are  not  CEA/  CBAs  of  ef- 
forts to  reduce  these  costs. 


Whereas  the  rule  tor  tangentially  related  method- 
ology references  was  exclusion,  OTA  adopted  a  pol- 
icy of  inclusiveness  when  classifying  references  as 
CEA  or  CBA.  As  described  immediately  below,  the 
literature  search  relied  heavily  on  published  and 
computer-based  indexes.  Many  of  the  studies  which 
purport  to  be  CEAs  or  CBAs  are  not  CEAs/CBAs  un- 
der the  definitions  of  chapter  1.  At  the  extreme,  for 
example,  at  least  one  article  whose  title  advertises  it 
as  presenting  a  cost-benefit  ratio  does  not  include  any 
such  comparison  of  costs  and  benefits  (47).  Rather 
than  weed  out  such  references,  OTA  included  all 
studies  which  are  known  to  be  CEA/CBAs  or  which 
are  presented  as  such  in  their  titles.  Chapter  3  iden- 
tifies most  of  the  studies  commonly  held  in  high 
regard. 

References  included  in  the  bibliography  were  ob- 
tained from  four  sources:  1)  computer-assisted  litera- 
ture searches,  2)  published  professional  literature  in- 
dexes, 3)  reference  lists  of  individual  articles,  papers, 
and  books,  and  4)  communication  with  leading 
health  services  researchers,  including  the  members  of 
the  Advisory  Panel  to  this  OTA  assessment. 

Two  computer-assisted  literature  searches  pro- 
vided numerous  references.  MEDLARS  covered  rele- 
vant citations  from  Index  Medicus.  For  the  years 
1966  through  1975,  this  search  covered  the  subject 
heading  "Cost  and  Cost  Analysis"  (which,  until  1976 
included  CEA  and  CBA).  From  1976  to  the  present, 
the  search  was  limited  to  the  Index  Medicus  subject 
heading  "Cost  Benefit  Analysis,"  a  heading  intro- 
duced in  1976  which  includes  both  CEA  and  CBA. 
The  second  computer-assisted  search  was  conducted 
by  the  National  Health  Planning  Information  Center, 
using  the  key  words  "cost-benefit  analysis"  and 
"cost-effectiveness  analysis." 

For  the  months  postdating  the  MEDLARS  search, 
Index  Medicus  was  consulted  directly.  Published  in- 
dexes also  supplied  many  relevant  economic  studies 
not  included  in  Index  Medicus.  Beginning  with  the 
1966  editions,  two  indexes  of  economic  literature 
were  selected:  the  Index  of  Economic  Articles  and  the 
Journal  of  Economic  Literature  (prior  to  1969  entitled 
the  Journal  of  Economic  Abstracts). 


NOTE:  Articles  and  other  materials  that  did  not  fit  the  criteria  for  inclusion  in  this  bibliography  but  that  were  used  in  the  writing  of  this  background  paper 
have  been  collected  as  "Other  References"  at  the  end  of  this  report.  References  in  the  text  to  this  bibliography  or  to  "Other  References"  may  be  distinguished  by 
the  number  of  the  reference.  Those  in  the  bibliography  are  numbered  from  1  through  601;  those  in  "Other  References"  are  numbered  from  701  upward. 
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Baker,  C,  and  Way,  L.,  "Clinical  Utility  of  CAT 
Body  Scans,"  Am.  J.  Surg.  136:37,  July  1978. 

This  CEA  of  computed  axial  tomography  (CAT)  body 
scans  employs  an  efficacy  scale  which  ranges  from  1  point 
(given  when  the  scan  is  deemed  to  have  saved  a  patient's 
life)  to  18  points  (given  when  the  scan  is  held  to  have  led  to 
a  patient's  death).  In  the  course  of  the  analysis,  the  sen- 
sitivity, specificity,  and  accuracy  of  CAT  body  scans  are 
evaluated.  The  authors  note  that  less  expensive  tests,  most 
notably  ultrasound,  are  bypassed  or  performed  simultane- 
ously with  CAT  scans.  Analysis  indicated  that  ultrasound 
and  CAT  scans  are  of  about  equal  clinical  value  in  any 
given  situation,  but  ultrasound  costs  one-fourth  as  much  as 
CAT  scanning.  The  authors  observe  that  clinicians,  when 
employing  CAT  scanning,  often  seem  to  have  no  clear  ex- 
pectations that  it  can  affect  patient  management.  They  also 
note  that  for  most  conditions  about  which  CAT  body 
scans  are  informative,  insufficient  information  is  not  the 
major  factor  limiting  the  success  of  therapy.  Though  this 
study,  limited  to  hospitalized  patients,  would  have  missed 
any  decreased  admissions  for  diagnostic  tests  which  may 
have  resulted  from  the  use  of  CAT  body  scanning,  its  au- 
thors believe  that  few  savings  can  be  expected  from  replac- 
ing other  diagnostic  procedures  with  CAT  scans.  They  rec- 
ommend that  CAT  body  scans  be  ordered  only  if  1)  more 
information  would  truly  affect  patient  management,  2) 
more  cost-effective  diagnostic  tests  have  failed,  and  3)  the 
likelihood  of  disease  is  high. 

The  authors  caution  that  their  study  was  done  as  CAT 
technology  was  rapidly  evolving.  This  evolution  has  obvi- 
ous implications,  including  the  likelihood  that  current  use 
patterns  (frequency  and  motivation)  differ  from  what  they 
will  become  if  and  when  body  scanning  becomes  standard 
practice.  As  such,  the  study  fails  to  distinguish  between 
cost  effectiveness  today  and  in  a  steady-state  situation  in 
the  future.  In  addition,  the  study  does  not  identify  poten- 
tial cost  efficacy  (i.e.,  cost  effectiveness  under  optimal  con- 
ditions). Despite  these  drawbacks,  this  study  stands  out  as 
one  of  the  very  few  which  have  attempted  to  identify  and 
quantify  patient  management  and  health  outcomes. 

Barnes,  B.,  "Cost-Benefit  Analysis  of  Surgery:  Cur- 
rent Accomplishments  and  Limitations,"  Am.  ]. 
Surg.  133:438,  April  1977. 

The  general  principles  of  CBA  are  presented,  with  a 
"good"  program  described  as  one  in  which  the  net  dis- 
counted benefits  exceed  zero.  The  author  says  that  CBA 
was  first  applied  to  health  care  in  response  to  rapidly  rising 
medical  care  expenditures.  When  conflict  between  individ- 
ual and  societal  interests  is  discerned,  the  techniques  of 
CBA  must  be  applied  with  sensitivity  to  the  individual  and 
public  interests  involved.  Limitations  of  CBA  in  health 


care  include  difficulties  in  accurately  accounting  for  the  nu- 
merous complex  costs  and  benefits  encountered,  in  identi- 
fying and  valuing  long-range  effects,  and  in  determining  a 
discount  rate  when  costs  and  benefits  are  deferred  many 
years. 

CBA  is  described  as  applicable  only  where  effects  are 
nearly  equivalent,  so  that  the  analysis  becomes,  in  effect,  a 
cost  comparison.  (However,  one  can  also  look  at  different 
effects  resulting  from  equivalent  costs.)  Three  examples  of 
CBA  as  applied  in  health  care  are  presented:  1)  considera- 
tion of  cholecystectomy  for  silent  gallstones,  2)  renal  trans- 
plantation or  chronic  hemodialysis  for  end-stage  renal  di- 
alysis, and  3)  intensive  care  unit  support  for  different  ill- 
nesses. 

The  author  states  that  the  accomplishments  of  CBA  and 
related  techniques  in  health  are  largely  those  of  more  com- 
prehensive understanding  of  the  advantages  or  disadvan- 
tages of  a  particular  therapy  or  policy.  In  itself,  CBA  is  sel- 
dom definitive,  but  in  conjunction  with  political  and  pro- 
fessional judgments,  it  can  improve  decisionmaking. 

Bartlett,  J.,  et  al.,  "Evaluating  Cost  Effectiveness  of 
Diagnostic  Equipment:  The  Brain  Scanner  Case,"  Br. 
Med.  J.  2:815,  Sept.  16,  1978. 

The  bulk  of  this  article  is  devoted  to  a  comparison  of  the 
costs  involved  in  five  different  options  for  implementing 
CAT  scanning  in  a  region  of  England.  The  net  costs  of 
CAT  scanning  are  calculated  as  gross  costs  (e.g.,  purchas- 
ing, installation,  staffing,  etc.)  minus  savings  from  the  de- 
creased .use  of  conventional  neuroradiology  and  reduced 
bed  days,  presumed  to  result  from  the  introduction  of 
CAT.  The  article  also  includes  a  discussion  of  possible 
treatment  improvements,  unquantified  and  not  included  in 
the  cost  of  calculations,  that  may  result  from  the  use  of 
CAT.  There  is  little  discussion  of  the  cost  effectiveness  of 
CAT  scanning  v.  conventional  neuroradiology,  though  the 
analysis  of  the  five  CAT  implementation  options  seems 
based  on  the  premise  that  CAT  is  more  cost  effective  in  cer- 
tain circumstances.  The  authors  acknowledge  the  lack  of 
precision  and  uncertainty  involved  in  the  savings  calcula- 
tions, but  contend  that  some  savings  do  result  from  the  in- 
troduction of  CAT  and  must  be  assessed  in  any  analysis. 

Bennett,  W.,  "Cost-Benefit  Ratio  of  Pretransplant  Bi- 
lateral Nephrectomy,"  J. A.M. A.  235:1703,  Apr.  19, 
1976. 

This  paper  is  an  example  of  how  titles  can  be  misleading. 
Despite  the  title,  there  is  not  a  single  cost-benefit  ratio  in 
the  entire  article.  The  author  compares  the  posttransplant 
course  of  patients  who  previously  had  had  their  kidneys  re- 
moved to  that  of  patients  who  had  had  no  pretransplant 
surgery.  The  latter  group  experienced  fewer  rejections  and 
better  survival. 


NOTE:  Three  types  of  entries  are  abstracted:  1)  many  of  the  better  known  studies  or  methodology  articles,  2)  several  examples  of  articles  of  varying  tech- 
nical sophistication  (that  is,  a  sample  of  the  general  literature),  and  3)  most  of  the  case  studies  prepared  or  supported  by  OTA  as  part  of  the  overall  assessment 
(see  app.  D) .  Inclusion  here  does  not  imply  that  any  particular  study  is  one  of  the  "best." 
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Bentkover,  J.  D.,  and  Drew,  P.  G.,  "Cost-Effective- 
ness/Cost-Benefit of  Medical  Technologies:  A  Case 
Study  of  Orthopedic  Joint  Implants,"  in  The  Impli- 
cations of  Cost-Effectiveness  Analysis  of  Medical 
Technology /Background  Paper  #2:  Case  Studies  of 
Medical  Technologies,  prepared  by  OTA,  U.S.  Con- 
gress (Washington,  D.C.:  in  press,  1980). 

This  study  examines  the  feasibility  and  potential  useful- 
ness of  undertaking  CEA/CBA  of  orthopedic  joint  prosthe- 
ses. Two  specific  issues  are  addressed:  1)  whether  it  is  feasi- 
ble to  evaluate  carefully  and  completely  the  orthopedic 
joint  implant  technology  within  a  CEA/CBA  framework; 
and  2)  how  could  such  an  evaluation  be  useful  in  for- 
mulating public  policy. 

The  authors  present  a  state-of-the-art  study  of  CEA/ 
CBA  as  it  pertains  to  this  technology.  They  do  not  try  to 
assess  the  technology.  The  study  includes  a  description  of 
the  technology  (joint  implants)  based  on  a  review  of  the 
literature,  communications  with  selected  medical  special- 
ists, and  conversations  with  representatives  of  the  ortho- 
pedic prostheses  industry.  The  authors  briefly  discuss 
alternative  forms  of  treatment  for  arthritis  and  point  out 
an  important  difference  between  the  alternatives  (e.g., 
drugs)  and  joint  implants:  Most  alternatives  are  only 
short-run  measures,  whereas  joint  implantation  is  a  long- 
term  measure. 

Few  data  are  available  regarding  the  efficacy  of  joint  im- 
plants. Data  regarding  the  efficacy  of  hip  replacements  are 
better  than  the  data  for  other  joint  implants  or  alternative 
measures.  They  may  even  be  acceptable.  Efficacy  studies 
are  in  progress  for  some  implants.  The  authors  did  not  ex- 
plore the  possibility  of  producing  the  result  (successful 
joint  implantation)  in  the  most  efficient  manner  possible. 

Potential  benefits  were  put  into  two  categories:  direct 
and  indirect.  Potential  direct  benefits  discussed  include  re- 
lief of  pain,  improved  functional  status  of  joint,  measures 
included  in  the  "Sickness  Impact  Profile"  (e.g.,  social  inter- 
actions, ambulation,  sleep,  leisure,  and  emotions),  quality- 
adjusted  life  years  (QALYs),  and  earnings.  Potential  in- 
direct benefits  include  averted  expenditures  for  the  caring 
for,  and  treatment  of,  individuals  handicapped  with  debili- 
tated joints,  e.g.,  those  with  severe  arthritis.  These  poten- 
tial benefits  were  only  mentioned;  none  were  quantified  or 
measured. 

Most  costs  mentioned  were  not  distinguished  from 
charges,  and  "avoidable"  costs  are  not  specifically  iden- 
tified. Some  indirect  costs,  e.g.,  loss  of  productivity  when 
patient  is  hospitalized,  were  identified.  The  author  points 
out  that  both  indirect  and  direct  costs  of  complications 
associated  with  joint  implants  must  be  included  as  well  as 
the  costs  of  followup  care  and  rehabilitation  therapy. 

The  authors  note  that  all  projected  benefits  and  costs 
should  be  discounted,  but  do  not  suggest  any  discount  rate 
in  particular.  They  do  suggest  that  variables  with  uncer- 
tain values,  e.g.,  discount  rates,  be  subjected  to  a  sensitivi- 
ty analysis.  Equity  issues  are  not  considered.  The  authors 
briefly  mention  some  potential  public  policy  implications 
of  conducting  CEA/CBA  of  orthopedic  joint  implants  but 
their  study  does  not  contain  specific  results  regarding  the 
cost  effectiveness  of  orthopedic  joint  implants. 


Budetti,  P.,  McManus,  P.,  Barrand,  N.,  and  Heinen, 

L.  A.,  "The  Costs  and  Effectiveness  of  Neonatal  In- 
tensive Care,"  in  The  Implications  of  Cost-Effective- 
ness Analysis  of  Medical  Technology/Background 
Paper  #2:  Case  Studies  of  Medical  Technologies,  pre- 
pared by  OTA,  U.S.  Congress  (Washington,  D.C.: 
in  press,  1980). 

This  paper  includes  a  review  of  the  efficacy  and  effec- 
tiveness literature,  as  well  as  the  "cost"  and  cost- 
effectiveness  literature,  on  neonatal  intensive  care  services. 
The  authors  note  the  rapid  progress  made  in  this  area  in 
the  last  15  years,  emphasizing  the  range  and  sophistication 
of  care  that  hospitals  can  now  offer.  Their  study  centers  on 
an  examination  of  costs,  personnel,  technologies,  and  pro- 
cedures used,  and  the  efficacy  and  effectiveness  of  the  in- 
tensive care  services  designed  to  provide  advanced  care  to 
severely  ill  newborns. 

Numerous  problems  involved  in  analyzing  neonatal  in- 
tensive care  services  are  identified.  First,  the  definitions  are 
very  tenuous.  Neonatal  services  in  many  hospitals  do  not 
fit  into  the  classifications  used.  Technological  or  personnel 
capabilities  vary  considerably  in  different  hospitals,  and 
regulatory  and  reimbursement  policies  create  incentives 
for  hospitals  to  classify  their  neonatal  units  inappropriate- 
ly. Providers,  paying  units,  and  regulators  disagree  on  uni- 
form definitions  that  should  be  applied  to  different  levels 
of  care. 

The  major  focus  of  the  study  is  on  efficacy,  effective- 
ness, and  costs  of  neonatal  intensive  care.  Outcomes  are 
defined  in  terms  of  improved  mortality  and  morbidity 
rates  and  mental  and  physical  development  of  critically  ill 
newborns.  Costs  are  distinguished  from  charges.  The 
study  addresses  the  average  cost  per  day  of  caring  for  the 
critically  ill  newborn  and  reimbursement  policies  and  pro- 
cedures. No  discount  rate  is  used.  Except  in  a  very  rough 
estimate  of  high  and  low  figures  for  use  and  the  cost  effec- 
tiveness of  caring  for  different  birthweight  infants,  sensi- 
tivity analysis  is  not  applied.  Equity  issues  are  not  ad- 
dressed. 

The  authors  examine  the  incidence  and  severity  of  pre- 
maturity in  the  United  States.  They  evaluate  the  social  and 
biological  aspects  of  prematurity,  trends  in  infant  mortal- 
ity, and  the  incidence  of  underweight  infants  in  the  last  two 
decades,  and  the  effect  of  neonatal  intensive  care  units 
(NICUs)  on  mortality  and  morbidity  of  premature  infants 
at  various  birthweights.  They  also  examine  the  use  of 
NICUs  via  admission  rates,  estimated  average  length  of 
stay,  estimated  total  patient  days,  the  number  of  hospitals 
with  NICUs,  and  the  number  of  intensive  care  beds. 

Next,  the  authors  examine  the  costs  of  neonatal  intensive 
care,  providing  a  caveat  that  the  data  on  use  and  cost  are 
very  rough  approximations.  The  authors  derive  the  cost 
and  use  data  from  small,  restricted  population  samples 
drawn  from  NICUs  that  vary  in  size,  shape,  and  capabili- 
ty. Data  were  examined  from  three  geographic  regions  and 
five  individual  centers,  along  with  numerous  studies  on 
neonatal  care.  Costs  associated  with  varying  degrees  of 
prematurity  and  severity  of  illness  were  examined,  as  well. 

In  general,  costs  are  directly  related  to  birthweight  and 
prematurity — the  lower  the  weight  and/or  the  earlier  the 
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birth,  the  higher  the  cost.  The  average  cost  per  day  in  the 
hospital  for  critically  ill  newborns  is  $267  for  an  average 
stay  of  13  days.  The  average  charge  per  day  was  about 
$394.  The  study  looks  at  the  existing  system  of  reimburse- 
ment for  the  cost  of  neonatal  intensive  care  in  five  States 
and  via  five  payers:  commercial  insurance,  Blue  Cross, 
medicaid,  self-pay,  and  private  insurance. 

NICUs  have  been  shown  to  reduce  mortality  rates,  and 
all  indications  are  that  NICUs  are  cost  effective.  Neverthe- 
less, more  data  is  needed  to  determine  their  full  impact. 
The  authors  review  studies  of  the  cost  effectiveness  or  ben- 
efit of  neonatal  intensive  care.  They  use  a  hybrid  cost- 
effectiveness  and  cost-benefit  analysis  developed  by  Mar- 
cia  Kramer  to  measure  marginal  costs  of  providing  neona- 
tal intensive  care.  They  also  compare  methods  of  care  in 
Great  Britain  and  France  with  those  in  the  United  States. 

The  authors  suggest  that  Federal  policies  need  to  be 
changed  to  reflect  changes  that  have  occurred  in  neonatal 
care.  In  particular,  they  suggest,  guidelines  that  establish 
maximum  numbers  of  beds  per  live  births  and  minimum 
sizes  of  neonatal  care  units  need  to  be  revised.  Also, 
medicaid  and  Social  Security  provisions  for  reimburse- 
ment of  neonatal  care  costs  need  to  be  reexamined.  The 
potential  ethical  implications  of  neonatal  intensive  care 
need  more  discussion. 

Cretin,  S.,  "Cost-Benefit  Analysis  of  Treatment  and 
Prevention  of  Myocardial  Infarction,"  Health  Serv. 
Res.  12:174,  summer  1977. 

This  article,  technically  a  CEA,  compares  the  effects  of 
three  alternative  methods  for  the  treatment  or  prevention 
of  myocardial  infarction:  1)  a  coronary  care  unit,  2)  a 
mobile  coronary  care  unit,  and  3)  an  intervention/preven- 
tion program  aimed  at  reducing  serum  cholesterol  levels. 
Effects  are  measured  in  terms  of  the  total  years  of  life 
added  as  a  result  of  each  alternative  program.  Costs  are 
classified  as  direct  and  indirect.  Costs  and  effects  of  each 
strategy  are  modeled  on  the  basis  of  a  cohort  of  10-year- 
olds  followed  throughout  their  lifetimes.  In  addition,  the 
manner  of  implementation  is  varied.  Costs  and  effects  are 
calculated  for  each  alternative  method  assuming  1)  the 
method  is  newly  introduced  alone,  and  2)  it  is  newly  in- 
troduced with  the  other  alternatives  ongoing.  "Cost- 
benefit"  ratios  are  calculated  as  the  dollar  cost  per  added 
year  of  life  for  each  alternative,  introduced  alone.  The 
author  illustrates  changes  in  the  ratios  that  result  from 
varying  the  discount  rate  (i.e.,  performs  sensitivity 
analysis),  using  rates  of  0,  5,  and  10  percent.  She  also  dis- 
cusses problems  of  selecting  a  discount  rate  for  comparing 
alternative  programs  that  incur  costs  and  accrue  benefits  at 
widely  separated  times.  The  author  finds  the  results  of  her 
analysis  inconclusive.  She  notes  that  this  and  other  model- 
ing processes  involve  many  simplifying  assumptions  and 
require  that  parameter  values  be  estimated  even  when  sup- 
porting data  is  scant. 

Doherty,  N.,  et  al.,  "Cost-Effectiveness  Analysis  and 
Alternative  Health  Care  Programs  for  the  Elderly," 
Health  Serv.  Res.  12:190,  summer  1977. 

In  this  article,  the  authors  discuss  the  method  of  CEA  in 
general,  contrast  it  with  CBA,  and  illustrate  it  with  an  ex- 


ample involving  alternative  programs  of  health  care  for  the 
elderly  (e.g.,  home  care,  day  care,  etc.).  They  also  discuss 
the  problems  of  measuring  costs  by  market  prices  which 
may  "obscure  the  real  opportunity  costs  of  resource  con- 
sumption." With  regard  to  effectiveness  criteria,  the 
authors  note  that  many  can  be  specified  only  in  terms  of 
ordinal  numbers  denoting  rank,  and  they  warn  against  the 
temptation  "to  add  the  nonadditive  and  to  compare  the  in- 
comparable." Costs  in  the  analysis  presented  as  an  exam- 
ple are  classified  as  primary,  secondary,  and  tertiary,  de- 
noting program  costs,  other  health-related  service  costs, 
and  personal  living  expenditures,  respectively.  The  au- 
thors explain  and  illustrate  the  tabular  display  approach  to 
presenting  data,  in  which  effectiveness  criteria  are  pre- 
sented in  columns  and  alternative  programs  are  presented 
as  row  headings.  It  is  unlikely,  the  authors  conclude,  that 
one  alternative  will  emerge  as  preferred  on  the  basis  of  all 
relevant  criteria.  In  their  example,  day  care  is  preferred  on 
the  basis  of  effectiveness  criteria,  while  home  care  is  pre- 
ferred on  the  basis  of  cost  criteria. 

Eddy,  D.,  "Rationale  for  the  Cancer  Screening  Bene- 
fits Program  Screening  Policies:  Implementation 
Plan,  Part  III,"  report  to  the  National  Cancer  Insti- 
tute, Blue  Cross  Association,  Chicago,  111.,  1978. 

This  report  describes  the  methods  used  to  analyze  the 
cost  effectiveness  of  alternative  cancer  screening  policy  op- 
tions and  the  rationale  for  a  recommended  insurance  bene- 
fits program.  Five  cancer  sites — breast,  colon,  cervix,  lung, 
and  bladder — were  selected  for  full  analysis.  The  model 
used  translates  the  problem  of  screening-program  effec- 
tiveness, and  many  variables  that  contribute  to  it,  into 
quantitative  terms  and  logical  relationships.  Probability 
formulas  relating  to  the  important  variables  are  derived. 
The  model,  designed  to  be  programed  on  a  computer, 
traces  the  expected  fate  of  a  patient  under  various  program 
options.  It  will  accept  information  about  patient  character- 
istics (age,  relative  risk,  previous  history,  incidence  rates, 
etc.)  and  will  program  options  and  present  information  on 
the  costs  and  effectiveness  of  a  specified  program.  Dif- 
ferent discount  rates  can  be  entered  into  it. 

The  author  notes  that  creating  a  cancer  screening  pro- 
gram that  is  both  medically  effective  and  low  in  cost  re- 
quires that  many  age,  sex,  and  risk  categories  be  used  to 
define  the  optimal  services  and  screening  frequencies  for 
various  groups  of  individuals.  Ideally,  a  program  might  in- 
clude several  screening  protocols,  each  tailored  to  different 
categories.  This  is  not  possible,  however,  for  a  prepaid 
benefit  program  that  will  be  purchased  by  a  large  hetero- 
geneous population.  Thus,  one  objective  is  to  design  a 
benefit  program  in  which  services  do  not  vary  greatly  for 
those  covered.  Marginal  effectiveness,  rather  than  absolute 
effectiveness,  was  considered  the  effectiveness  criterion, 
and  on  this  basis,  there  is  little  difference  in  the  cost-effec- 
tive program  for  high-risk  as  compared  to  average-risk 
groups.  The  benefit  program  designed  includes  the  follow- 
ing provisions:  1)  a  standard  screening  program  will  be 
provided  every  4  years  for  persons  aged  25  to  45;  2)  a 
standard  screening  program  will  be  provided  every  year 
for  those  over  age  45;  3)  an  impregnated  guaiac  slide  will 
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be  provided  every  year  beginning  at  age  45;  4)  a  Pap  smear 
will  be  provided  to  women  every  4  years  beginning  at  age 
25;  5)  a  mammography  will  be  provided  to  women  covered 
by  the  high-option  benefit  every  2  years  beginning  at  age 
50;  6)  a  proctosigmoidoscopy  will  be  provided  every  5 
years  beginning  at  age  50. 

Eddy,  D.,  "Screening  for  Colon  Cancer:  A  Technol- 
ogy Assessment,"  in  The  Implications  of  Cost-Effec- 
tiveness Analysis  of  Medical  Technology/Back- 
ground Paper  #2:  Case  Studies  of  Medical  Technol- 
ogies, prepared  by  OTA,  U.S.  Congress  (Washing- 
ton, D.C.:  in  press,  1980). 

This  study  focuses  on  the  techniques  that  are  available  to 
screen  for  colon  cancer — their  development,  evaluation, 
use,  and  cost  effectiveness. 

The  author  examines  the  three  basic  methods  of  tech- 
niques used  in  the  detection  of  colon  cancer:  1)  the  digital 
exam,  2)  the  sigmoidoscope,  and  3)  the  test  for  occult 
blood  in  the  stool.  For  each  method,  the  author  notes, 
there  is  either  some  degree  of  uncertainty  regarding  the 
sensitivity  and  specificity  of  the  tests,  or  some  degree  of 
risk  to  the  patient  involved. 

The  study  points  out  that  there  have  been  few,  if  any, 
clinical  studies  of  the  digital  exam.  Its  effectiveness  has 
been  proven  via  the  "time-honored"  method  of  use  and  ac- 
ceptable results  at  the  patient-provider  level.  The  effec- 
tiveness of  sigmoidoscopes  has  been  examined  in  a  few 
clinical  studies.  The  Hemoccult  test  has  been  through,  and 
is  going  through,  a  number  of  large  clinical  trials  to 
evaluate  its  efficacy.  To  date,  the  results  are  inconclusive. 

The  author  discusses  the  problems  that  exist  in  trying  to 
apply  CEA  to  colon  cancer  screening  programs.  He  also 
examines  a  number  of  factors  that  affect  CEA  studies  in  the 
health  care  area  in  general.  One  is  the  need  for,  but  absence 
of,  information  from  formal  randomized  clinical  trials 
regarding  the  effect  and  value  of  screening  techniques.  The 
information  that  is  available  is  usually  from  uncontrolled 
studies  that  are  burdened  with  problems  of  their  own.  Fac- 
tors such  as  leadtime  bias,  patient-self-selection  bias,  and 
length-of-study-period  bias  also  present  data  problems 
that  must  be  considered.  Another  problem  for  the  analyst 
are  the  quantitative  aspects  of  trying  to  measure  the  costs, 
benefits,  risks,  or  outcomes  of  the  different  colon  cancer 
screening  programs. 

The  author  also  discusses  the  special  considerations  that 
colon  screening  programs  present  to  a  CEA.  These  factors 
include  patient  characteristics  and  differences  (in  terms  of 
effectiveness  of  screening  programs),  schedule  (or  history) 
and  type  of  testing  procedures  used,  varying  accuracy  of 
the  different  procedures,  different  origins  of  the  cancer  that 
require  separate  analysis,  order  and  frequency  of  testing, 
and  a  host  of  other  variables  that  must  be  included  in  a 
thorough  evaluation. 

Once,  or  if,  these  data  and  methodological  problems  are 
solved,  the  author  feels  the  central  issue  can  be  addressed: 
What  is  the  value  of  screening  for  colon  cancer?  The  au- 
thor sets  out  the  basic  format  for  addressing  the  problems 
involved  in  a  CEA  approach.  An  illustrative  example  is 
used  to  examine  the  costs  and  benefits  of  screening  for  col- 


on cancer.  A  screening  program  for  a  50-year-old  average 
risk  woman  is  evaluated  using  eight  different  combinations 
and  frequencies  of  screening  tests.  The  relevant  factors 
(costs,  screening  regimen,  efficacy  data,  outcome  informa- 
tion, etc.)  are  examined  by  the  author,  using  a  sensitivity 
analysis  approach  to  determine  how  the  different  variables 
affect  the  mortality  rate  and  cost  of  the  various  screening 
programs.  The  result  of  the  analysis  is  presented  as  a  com- 
parison between  the  decreasing  probabilities  of  colon  can- 
cer's occurring  with  more  frequent  testing,  improved  life 
expectancy  changes,  increases  in  screening  costs,  and  de- 
creases in  lost  earnings  as  a  result  of  the  different  levels  of 
screening  programs. 

Fineberg,  H.  V.,  and  Pearlman,  L.  A.,  "Benefit  and 
Cost  Analysis  of  Medical  Interventions:  The  Case  of 
Cimetidine  and  Peptic  Ulcer  Disease,"  in  The  Impli- 
cations of  Cost-Effectiveness  Analysis  of  Medical 
Technology / Background  Paper  #2:  Case  Studies  of 
Medical  Technologies,  prepared  by  OTA,  U.S.  Con- 
gress (Washington,  D.C.:  in  press,  1980). 

The  study  has  two  major  goals:  One  is  to  assess  the 
available  evidence  regarding  the  benefits  and  costs  of 
cimetidine  in  the  treatment  of  peptic  ulcer  disease;  the 
other  is  to  develop  a  widely  applicable  cost-benefit  model 
for  evaluation  of  medical  technology.  The  study  combines 
these  two  objectives  by  applying  the  model  to  the  evalua- 
tion of  cimetidine  and  ulcer  disease.  The  authors  approach 
the  analysis  in  three  parts:  1)  a  development  and  discussion 
of  the  cost-benefit  model  that  they  feel  can  be  applied  to 
medical  interventions  in  general;  2)  an  overview  of  peptic 
ulcer  disease  in  the  United  States;  and  3)  a  discussion  of  the 
development,  diffusion,  and  use  of  cimetidine  to  treat 
and/or  manage  peptic  ulcer  disease. 

The  foundation  of  their  cost-benefit  model  is  as  follows: 
1)  There  are  two  principal  classes  of  effects — clinical  effects 
and  health  system  effects — and  the  specific  components  of 
these  effects  depend  on  the  population  and  intervention  be- 
ing examined;  2)  an  evaluative  model  must  apply  to  an 
identifiable  patient  population  and  specific  health  care  in- 
terventions; 3)  a  patient  population  may  be  defined  in 
terms  of  a  diagnostic  category,  clinical  signs  or  symptoms, 
risk  factors,  or  complications  of  disease;  and  4)  clinical  and 
health  system  effects  interact  to  lead  to  an  outcome  (health 
status  and/ or  resource  costs). 

The  authors  examine  a  host  of  studies  dealing  with  the 
safety,  efficacy,  and  effectiveness  of  cimetidine.  Among 
the  short-term  clinical  effects  they  assess  are  healing,  pain 
relief,  safety  and  adherence  to  the  treatment  plan,  compli- 
cations, recurrence,  and  recommendations  for  treating 
newly  diagnosed,  uncomplicated  ulcers.  The  long-term 
clinical  effects  they  examine  are  recurrence,  safety,  and 
complications.  They  also  briefly  discuss  the  pending  ap- 
proval by  the  Food  and  Drug  Administration  of  cimetidine 
for  long-term  use. 

The  authors  also  examine  the  health  system  and  out- 
come effects  of  cimetidine  use.  Among  the  variables  evalu- 
ated are  medication,  diagnostic  tests,  physician  visits, 
mortality,  morbidity,  and  resource  costs.  These  three  areas 
—clinical  effects,  health  system  effects,  and  outcomes  of 
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cimetidine  use — are  the  primary  elements  of  the  CBA  they 
perform. 

The  authors  also  examine  and  discuss  the  following  find- 
ings: Cimetidine  promotes  healing  and  provides  faster  and 
more  complete  pain  relief  for  duodenal  ulcers;  it  may  be 
more  effective  than  placebos  for  patients  with  gastric 
ulcers;  when  used  for  up  to  2  months,  cimetidine  appears 
to  be  a  relatively  safe  drug;  most  known  side  effects  are 
minor  or  reversible;  cimetidine  plus  moderate  amounts  of 
antacid  costs  no  more  than  a  therapeutically  equivalent 
course  of  intense  antacid  therapy;  and  maintenance  treat- 
ment with  cimetidine  for  as  long  as  a  year  significantly 
reduced  the  chance  of  ulcer  recurrence  (compared  to  a  pla- 
cebo) during  the  period  of  treatment.  Cimetidine,  accord- 
ing to  a  few  studies,  also  appears  to  have  contributed  to  a 
sharp  decline  in  surgery  for  ulcer  disease  in  1978,  as  well  as 
to  have  helped  patients  to  lose  significantly  fewer  days  of 
work  than  patients  given  a  placebo. 

These  many  findings  and  conclusions  indicate  that  cime- 
tidine provides  a  substantial  benefit  to  cost  ratio  to  the 
peptic  ulcer  patient  and  the  health  care  system.  The  au- 
thors cite  the  findings  of  two  other  studies;  one  by  the 
Netherlands  Economic  Institute  in  1977  and  the  other  by 
Robinson  Associates,  Inc.,  in  1978.  The  authors  conduct 
an  in-depth  review  and  critique  of  the  Robinson  study. 

Geiser,  E.,  and  Menz,  F.,  "The  Effectiveness  of  Public 
Dental  Care  Programs,"  Med.  Care  14:189,  March 
1976. 

This  CBA  examines  the  costs  and  benefits  of  a  public 
dental  care  program  designed  to  "maintain  the  integrity  of 
the  natural  teeth"  in  school-age  children.  Benefits  are 
calculated  by  estimating  the  number  of  teeth  "saved"  in  15- 
year-olds  that  are  a  result  of  the  program,  and  then  multi- 
plying it  by  the  cost  of  replacing  a  natural  tooth  with  an  ar- 
tificial bridge.  The  current  costs  of  saving  a  permanent 
tooth  are  used  as  a  cost  measure.  Data  from  two  actual 
public  dental  care  programs  are  examined.  The  authors 
conclude  that  public  dental  care  programs  must  be  admin- 
istered over  a  relatively  long  period  of  time  (6  to  7  years) 
before  net  benefits  begin  to  accrue  on  an  annual  basis.  An 
even  longer  period  of  time  (11  to  14  years)  is  required  be- 
fore the  programs  generate  sufficient  total  benefits  to  cover 
total  costs.  The  discounted  present  values  of  the  program, 
with  use  of  an  8-percent  discount  rate,  were  found  to  be 
particularly  sensitive  to  changes  in  the  cost  of  care  and  the 
value  of  saving  a  tooth.  Extensive  sensitivity  analysis  is 
performed  on  the  variables  involved,  making  this  article 
an  excellent  illustration  of  the  use  of  sensitivity  analysis  in 
handling  uncertainty. 

Grosse,  R.,  "Cost-Benefit  Analysis  of  Health  Serv- 
ices," Ann.  Am.  Acad.  Polit.  Soc.  Sci.  399:89,  Janu- 
ary 1972. 

This  article,  a  general  review  rather  than  an  analysis, 
presents  an  explanation  of  the  rationale  behind  the  use  of 
CEA  and  CBA  in  the  allocation  of  health  resources  and  de- 
scribes an  application  by  HEW.  Costs  are  described  as  for- 
gone benefits:  "The  cost  of  saving  a  human  life  is  not  to  be 
measured  in  dollars,  but  rather  in  terms  of  alternative  lives 


to  be  saved  or  other  social  values  sacrificed."  The  problem 
of  incommensurability  of  benefits  is  discussed.  HEW's  cal- 
culations of  the  cost  per  death  averted  and  of  productivity 
and  medical  treatment  savings  in  various  cancer  control 
programs  are  presented  and  compared  to  other  health  pro- 
grams (e.g.,  motor  vehicles  safety  and  arthritis).  The  arti- 
cle illustrates  the  changes  in  program  priority  that  can  oc- 
cur when  the  criterion  is  changed  from  deaths  averted  to 
savings  from  avoided  medical  treatment  and  loss  of  pro- 
ductivity (measured  as  discounted  lifetime  earnings).  The 
problem  of  uncertainty  is  discussed,  and  a  matrix  com- 
posed of  relative  payoffs  and  the  certainty  of  results  is  pre- 
sented as  one  method  of  handling  it.  The  final  section  of 
the  article  describes  in  detail  the  HEW  maternal  and  child 
health  program  analysis. 

Hagard,  S.,  et  al.,  "Preventing  the  Birth  of  Infants 
With  Down's  Syndrome:  A  Cost-Benefit  Analysis," 
Br.  Med.  J.  1:753,  Mar.  27,  1976. 

The  costs  and  benefits  of  providing  routine  prenatal  di- 
agnosis, with  termination  of  affected  pregnancies,  are  ex- 
amined. In  the  event  of  pregnancy  termination,  two  situa- 
tions are  considered:  1)  Termination  is  followed  by  a  fur- 
ther pregnancy,  assumed  to  be  normal  (replacement);  and 
2)  termination  is  not  followed  by  a  further  pregnancy  (no 
replacement).  Since  such  prenatal  testing  could  diagnose 
fetal  myelocele,  the  costs  and  benefits  involved  in  prevent- 
ing this  disease  are  also  taken  into  consideration.  For 
Down's  syndrome,  during  the  period  1975-94,  the  follow- 
ing numbers  are  estimated:  1)  the  number  of  births  by  5- 
year  maternal  age  groups,  2)  survival  rates  and  the  degree 
of  handicap  of  survivors,  3)  costs  to  society  of  caring  for 
survivors,  4)  characteristics,  including  the  number  of  af- 
fected births  prevented,  of  a  prenatal  diagnostic  program, 
and  5)  the  costs  of  such  a  program.  The  benefit  of  prevent- 
ing the  birth  of  infants  with  Down's  syndrome  is  calculated 
as  the  cost  to  the  community  of  their  care.  In  the  case  of  re- 
placement, this  is  the  difference  between  the  cost  of  caring 
for  a  handicapped  person  and  the  cost  of  caring  for  a  nor- 
mal person.  In  the  case  of  no  replacement,  this  is  the  cost  of 
caring  for  a  handicapped  person.  Results  of  the  study  indi- 
cate that  the  benefit-cost  ratio  of  prenatal  diagnosis  is 
greater  than  1  for  women  over  40  years  old,  equal  to  1  for 
women  between  35  and  45  years,  and  less  than  1  for 
women  under  35  years.  The  problems  associated  with  dif- 
ferent results  for  different  age  groups  are  discussed.  A  dis- 
count rate  of  10  percent  is  used.  The  authors  examine  the 
changes  in  the  results  of  the  analysis  that  would  occur  if, 
after  genetic  counseling,  only  half  of  the  women  accepted 
amniocentesis  and  possible  termination  of  pregnancy. 

Harris,  G.,  "Introduction  to  Cost-Benefit  Analysis 
Applied  to  New  Health  Technologies,"  prepared  by 
Arthur  D.  Little,  Inc.,  for  Bureau  of  Health  Planning 
and  Resource  Development,  Health  Resources  Ad- 
ministration, Hyattsville,  Md.,  December  1977. 

This  document  describes  the  steps  in  CBA  as  the  follow- 
ing: 1)  articulation  of  the  problem,  2)  enumeration  of  alter- 
natives to  address  the  problem,  3)  identification  of  their 
achievable  effects,  4)  measurement  and  valuation  of  the 
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achievable  effects,  and  5)  application  of  the  economic  deci- 
sion criteria.  Objectives  are  described  as  cost  reduction 
and/or  enhancing  of  benefits.  Costs  and  benefits  are  classi- 
fied as  direct,  indirect,  or  intangible.  The  need  to  focus  on 
incremental,  rather  than  total,  costs  and  benefits  is  ex- 
plained. Discounting  to  present  value  and  the  problem  of 
choosing  a  discount  rate  are  discussed.  Five  criteria  of 
preferredness  are  described:  1)  net  present  benefit,  2)  inter- 
nal rate-of-return,  3)  benefit-cost  ratio,  4)  payback  period, 
and  5)  average  rate  of  return.  The  advantages,  disadvan- 
tages, and  appropriate  use  of  each  criterion  are  presented. 
Threshold  analysis,  sensitivity  analysis,  and  probabili- 
ty/risk analysis  are  described  as  methods  of  dealing  with 
uncertainty.  Common  problems  encountered  in  analysis, 
such  as  incomplete  data,  transitional  costs,  scope,  and  ex- 
ternalities, and  the  issue  of  equity  and  distribution  are 
discussed. 

Klarman,  H.,  et  al.,  "Cost-Effectiveness  Analysis  Ap- 
plied to  the  Treatment  of  Chronic  Renal  Disease," 
Med.  Care  6:48,  January-February  1968. 

The  authors  attempt  to  determine  the  best  mix  of  center 
dialysis,  home  dialysis,  and  kidney  transplantation  in  ex- 
amining the  costs  and  effects  of  treating  chronic  renal  dis- 
ease. A  quality-of-life  adjustment  is  made  to  account  for 
the  differences  in  lifestyle  between  patients  on  dialysis  and 
those  with  effective  transplants.  (The  freedom  associated 
with  the  latter  is  valued  at  0.25  of  a  life-year.)  The  calcula- 
tions in  the  analysis  are  based  on  survivorship  tables  for 
transplant  and  dialysis  cohorts  of  1,000  each.  The  authors 
warn  that,  at  the  time  of  the  analysis,  there  had  not  been 
enough  experience  with  any  of  the  three  treatment  modes 
to  generate  an  expected  life  table  with  great  accuracy.  The 
discount  rate  used  is  net  of  an  anticipated  inflation  rate,  re- 
sulting in  a  discount  rate  of  4  percent  for  transplant  and 
center  dialysis  and  5  percent  for  home  dialysis.  No  sen- 
sitivity analysis  is  presented  for  the  discount  rate,  the  an- 
ticipated inflation  rate,  or  life  expectancy.  The  authors 
conclude  that  kidney  transplantation  is  more  cost  effective 
than  the  other  two  alternatives.  Choice  of  the  preferred 
treatment  modality  is  independent  of  the  quality-of-life  ad- 
justment because  transplantation  dominates  even  without 
the  adjustment. 

Korenbrot,  C,  Flood,  A.,  Higgins,  M.,  Roos,  N., 
and  Bunker,  J.,*  "Elective  Hysterectomy:  Costs, 
Risks,  and  Benefits,"  in  The  Implications  of  Cost- 
Effectiveness  Analysis  of  Medical  Technology/ Back- 
ground Paper  #2:  Case  Studies  of  Medical  Technol- 
ogies, prepared  by  OTA,  U.S.  Congress  (Washing- 
ton, D.C.:  in  press,  1980). 

This  study  examines  elective  hysterectomy  as  it  is  used 
for  sterilization  and  cancer  prevention.  The  focus  of  the 
study  is  a  review  of  the  literature  and  the  issues  surround- 
ing the  costs,  risks,  and  benefits  of  elective  hysterectomy. 
The  study  does  not  attempt  to  establish  the  cost  effective- 
ness of  hysterectomy.  The  authors  examine  the  significant 
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side  effects  of  hysterectomy,  such  as  change  in  medical  uti- 
lization and  psychological  effects  following  surgery. 

The  authors  review  selected  studies  that  evaluate  the  ef- 
ficiency and  cost  effectiveness  of  elective  hysterectomies. 
Not  taking  a  cost-benefit  approach,  these  studies  do  not  at- 
tempt to  value  the  saving  of  life  in  monetary  terms.  The 
first  two  efficiency  studies  that  the  authors'  review  contrast 
the  direct  costs  of  hysterectomy  with  the  net  lifetime  costs 
of  gynecological  care.  Future  costs  are  discounted  at  rates 
varying  from  3  to  6.5  percent.  Another  study  the  authors 
review  examines  the  use  of  hysterectomy  as  a  sterilization 
device  v.  the  direct  costs  of  tubal  ligation  plus  the  expense 
of  future  gynecological  care  which  would  have  been 
averted  by  hysterectomy. 

The  effectiveness  of  hysterectomies  in  preventing  preg- 
nancy and  cancer  is  not  an  issue;  but  the  health  risks  of  the 
procedure  are.  Efficacy/effectiveness  of  alternative  means 
to  accomplish  these  objectives  are  assessed,  but  not  in  the 
cost-effectiveness  studies  reviewed.  Additionally,  the  cost- 
effectiveness  studies  which  are  reviewed  do  not  attempt  to 
identify,  measure,  or  place  a  value  on  the  side  effects  of 
surgery. 

Costs  are  distinguished  from  charges  and  issues  of  equity 
are  discussed.  The  authors  do  not  employ  a  sensitivity 
analysis.  Conclusions  are  drawn  with  respect  to  the  cost  ef- 
fectiveness of  elective  hysterectomies  as  they  are  used  for 
the  separate  purposes  that  are  examined. 

Leroy,  L.,  and  Solkowitz,  S.,  "Costs  and  Effective- 
ness of  Nurse  Practitioners,"  in  The  Implications  of 
Cost-Effectiveness  Analysis  of  Medical  Technology/ 
Background  Paper  #2:  Case  Studies  of  Medical  Tech- 
nologies, prepared  by  OTA,  U.S.  Congress  (Wash- 
ington, D.C.:  in  press,  1980). 

This  study  reviews  the  literature  on  the  cost  effectiveness 
of  nurse  practitioners  to  provide  primary  medical  care 
services.  Only  limited  data  are  available,  and  much  of  the 
information  deals  with  other  types  of  physician  extenders. 
In  addition,  many  of  the  data  have  been  gathered  in  the 
developmental  stage  of  introducing  nurse  practitioners;  the 
relevance  of  these  data  for  present  policy  purposes  is 
unclear. 

At  least  theoretically,  nurse  practitioners  offer  the  po- 
tential to  reduce  the  costs  of  health  care  and  improve  ac- 
cess to  the  health  care  system.  Nurse  practitioners  can  per- 
form basic  and  routine  medical  care  tasks,  allowing  physi- 
cians to  focus  their  efforts  on  serious  illness  problems. 
Training  costs  and  pay  are  less  for  nurse  practitioners  than 
for  physicians,  so  costs  should  be  lower  for  routine  care  if 
nurse  practitioners  are  used.  There  are  a  number  of  prob- 
lems in  directly  extrapolating  to  lower  costs,  however, 
and,  depending  on  the  system  within  which  nurse  practi- 
tioners operate,  cost  savings  may  or  may  not  be  realized. 

A  key  question  examined  by  this  study  deals  with  the 
nature  of  the  services  nurse  practitioners  perform  and  how 
they  affect  costs.  In  general,  they  provide  complementary 
and  substitute  services,  although  the  nature  of  these  serv- 
ices is  difficult  to  document  because  data  often  indicate 
only  "office  visit."  Complementary  services  would  include 
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treatment  such  as  "well  baby  care,"  while  substitutive  serv- 
ices refers  to  such  treatment  as  "physicals." 

In  terms  of  quality  of  care,  nurse  practitioners  appear  to 
provide  care  that  is  of  as  high  quality  as  that  of  physicians 
(with  whom  they  usually  work  and  are  compared).  There 
is  some  evidence  that  nurse  practitioners,  working  in  close 
conjunction  with  physicians,  provide  superior  care  when 
compared  to  solo  practitioners.  Productivity  is  more  dif- 
ficult to  assess  and  depends  on  how  nurse  practitioners  are 
used.  There  seems  to  be  clear  evidence  that  the  use  of  nurse 
practitioners  improves  physicians'  productivity,  but  it  is 
not  clear  how  this  improved  productivity  affects  costs.  Su- 
pervisory time,  duplicative  work,  and  the  fact  that  nurse 
practitioners  spend  more  time  per  patient  must  be  consid- 
ered. 

The  data  needed  to  conduct  a  CEA  of  nurse  practitioners 
include  employment  costs,  training  costs,  and  medical  care 
costs.  Unfortunately,  each  of  these  factors  may  be  subject 
to  changes  as  a  result  of  alterations  in  another  part  of  the 
system.  The  employment  costs  of  nurse  practitioners,  for 
example,  is  a  function  (in  part)  of  the  demand  for  their 
services.  Even  more  difficult  to  determine  is  price.  Because 
they  are  most  often  hired  by  physicians  or  health  institu- 
tions which  have  already  established  fee  systems,  any  cost 
savings  may  be  absorbed  by  the  physicians  or  institutions 
and  may  not  be  reflected  in  the  price  of  services  delivered. 

The  case  concludes  by  cautioning  against  the  use  of  cur- 
rent data  to  determine  new  policy.  Based  on  changes  in  the 
way  nurse  practitioners  are  used,  costs  could  vary  widely. 
This  is  a  case  in  which  an  actual  CEA  may  provide  mis- 
leading policy  advice,  although  the  identification  of  vari- 
ables required  by  the  CEA  may  be  very  helpful. 

Lesourd,  D.,  et  al.,  Benefit-Cost  Analysis  of  Kidney 
Disease  Programs,  PHS  publication  No.  1941,  pre- 
pared by  the  Research  Triangle  Institute  (Washing- 
ton, D.C.:  U.S.  Government  Printing  Office,  1968). 

This  analysis  was  one  of  a  series  of  federally  sponsored 
efforts  to  assess  the  costs  and  benefits  of  alternative  ap- 
proaches to  the  problem  of  kidney  disease.  The  approaches 
included  screening,  prevention,  and  three  treatment  mo- 
dalities (home  dialysis,  center  dialysis,  and  transplanta- 
tion). Employing  a  variety  of  assumptions  (e.g.,  risk  pop- 
ulation for  the  screening  programs,  size  of  treatment  facil- 
ities), the  authors  concluded  that  early  detection  dramat- 
ically dominated  the  treatment  approaches  with  respect  to 
economic  benefits  and  costs.  Depending  on  the  population 
screened,  the  former  had  benefit-cost  ratios  of  30:1  and 
greater.  By  contrast,  the  treatment  alternatives  produced 
benefit-cost  ratios  in  the  vicinity  of  1:1.  This  ratio  varied 
according  to:  1)  the  treatment  method  (transplantation 
producing  the  highest  ratios);  2)  the  scale  of  operation;  3) 
the  allocation  of  research  costs;  and  4)  high,  low,  and  best 
cost  estimates  in  the  two  instances  of  dialysis.  To  estimate 
indirect  benefits  (i.e.,  productivity  losses  avoided),  the 
authors  assumed  that  70  percent  of  the  dialysis  patients 
would  be  capable  of  resuming  a  normal  earning  capacity; 
the  remaining  30  percent  were  assigned  half  the  expected 
income  of  a  comparable  but  healthy  individual. 


The  qualitative  findings  of  this  analysis  were  supported 
by  other  studies  undertaken  at  the  same  time.  Despite  the 
consensus  that  prevention  and  early  detection  were  the 
most  cost-effective  approaches  to  dealing  with  the  kidney 
disease  problem,  Federal  policy  was  directed  toward  the 
alternative  which  appeared  least  economically  desirable, 
center  dialysis. 


Lubeck,  D.  P.,  and  Bunker,  J.  P.,  "The  Artificial 
Heart:  Costs,  Risks,  and  Benefits,"  in  The  Implica- 
tions of  Cost-Effectiveness  Analysis  of  Medical  Tech- 
nology/Background Paper  #2:  Case  Studies  of  Medi- 
cal Technologies,  prepared  by  OTA,  U.S.  Congress 
(Washington,  D.C.:  in  press,  1980). 

This  study  examines  the  many  factors  that  have  played  a 
role  in  the  development  of  the  artificial  heart:  factors  that 
are  affected  by,  and  in  turn  affect,  three  areas  of  public 
policy — R&D,  reimbursement,  and  regulation. 

The  authors  provide  a  backdrop  of  the  history  of  the  ar- 
tificial heart  development  program.  They  also  examine  the 
safety  and  efficacy  determinations  that  have  been  arrived 
at  through  experiments  and  clinical  trials.  The  current  and 
potential  technological  developments  that  are  or  will  be, 
part  of  the  artificial  heart  are  described,  and  the  numerous 
R&D  needs  that  must  be  met  before  an  artificial  heart  can 
be  successfully  used  are  examined. 

The  authors  examine  the  economic  aspects  of  the  artifi- 
cial heart  from  the  patient's  perspective  and  from  a  societal 
view,  focusing  on  the  costs  of  diagnosis,  implantation,  and 
postoperative  care.  These  costs  are  compared  to  the  costs 
associated  with  related  procedures:  cardiac  pacemakers, 
aortocoronary  bypass  surgery,  and  heart  transplants.  The 
renal  dialysis  program  is  used  to  illustrate  the  possibility  of 
the  Federal  Government's  financing  artificial  heart  pro- 
cedures and  the  distribution  of  services  to  the  population. 

The  authors  also  examine  four  social  cost  areas:  in- 
creased social  expenditures,  potential  distributional  inequi- 
ties, effects  of  nuclear  radiation  if  a  nuclear  energy  source 
is  used,  and  the  opportunity  costs.  They  also  examine  the 
efficacy,  potential  benefits  and  costs,  and  likelihood  of 
saving  lives  by  cardiac  disease  prevention  programs. 

Quality  of  life  issues  are  addressed  for  both  the  short- 
and  long-term  effects.  The  authors  draw  on  the  experiences 
of  those  who  have  had  heart  and  kidney  transplants  to  il- 
lustrate the  types  of  impacts  on  the  patient  and  the  family 
that  can  occur.  The  potential  effects  include  personal, 
marital,  family,  physical,  medical,  and  psychological 
problems  that  can  occur  after  a  person  undergoes  major 
surgery.  The  authors  also  discuss  the  added  burdens/im- 
pacts that  will  result  if  a  nuclear-powered  energy  source  is 
used. 

On  the  benefits  side,  although  the  authors  briefly  discuss 
the  technological  spinoffs  of  the  artificial  heart  program, 
their  primary  focus  is  on  two  areas:  the  potential  for  pa- 
tients returning  to  an  active  life,  and  the  estimated  years  of 
life  that  may  be  gained.  Morbidity,  mortality,  and  added 
years  of  life  are  examined  and  estimated  via  a  best  case  and 
worst  case  analysis  if  the  artificial  heart  is  implanted. 
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Luce,  B.,  "Allocating  Costs  and  Benefits  in  Disease 
Prevention  Programs:  An  Application  to  Cervical 
Cancer  Screening,"  in  The  Implications  of  Cost-Ef- 
fectiveness Analysis  of  Medical  Technology/ Back- 
ground Paper  #2:  Case  Studies  of  Medical  Technol- 
ogies, prepared  by  OTA  U.S.  Congress  (Washing- 
ton, D.C.:  in  press,  1980). 

This  author  believes  that  one  important  reason  for  the 
reluctance  to  fund  disease  prevention/health  promotion 
programs  is  that  benefits  often  do  not  accrue  sufficiently  to 
those  who  incur  the  costs.  Also,  the  private  sector  is  ex- 
pected to  fund  such  programs.  Consequently,  traditional 
CEAs  which  are  performed  only  from  the  societal  perspec- 
tive may  not  be  applicable  for  public  policy. 

This  author  performs  a  CEA  of  cervical  cancer  screening 
for  a  given  risk  group  from  different  perspectives.  Screen- 
ing for  cervical  cancer  is  used  to  demonstrate  the  cost  effec- 
tiveness of  disease  prevention  programs.  The  disease  proc- 
ess is  modeled  by  the  author  using  a  Markov  Chain  tech- 
nique to  "age"  a  simulated  population  of  30-  to  39-year-old 
women  for  10  years  (using  disease  transition  probabilities 
reported  in  the  literature).  The  cost  effectiveness  of  screen- 
ing is  then  calculated  at  different  intervals— ranging  from 
annual  screening  to  no  screening  for  the  10-year  period. 
The  effects  are  evaluated  for:  1)  different  migration  pat- 
terns, 2)  different  risk  groups,  3)  different  modes  of  admin- 
istering Pap  tests,  and  4)  joint  production  considerations. 
The  author  also  tests  the  sensitivity  of  the  results  to 
various  discount  rates  and  to  the  range  of  error  rates  for 
Pap  tests. 

The  results  indicate  that  a  private  party  always  has  a  fi- 
nancial incentive  to  postpone  screening,  whereas  society 
finds  it  more  cost  effective  to  screen,  but  only  at  infrequent 
intervals.  In  addition,  the  author  notes,  the  cost  effec- 
tiveness of  screening  is  markedly  affected  when  a  more  effi- 
cient (i.e.,  less  costly)  delivery  mode  is  simulated.  Screen- 
ing is  significantly  affected  when  joint  production  effects 
are  considered.  The  cost  effectiveness  of  screening,  how- 
ever, is  not  very  sensitive  to  small  changes  in  the  discount 
rate,  initially  set  at  10  percent,  nor  to  varying  assumptions 
regarding  error  rates. 

The  author  concludes  that  if  society  wants  the  private 
sector  to  screen  for  cervical  cancer  at  a  socially  determined 
optimal  rate,  then  society  must  be  willing  to  subsidize  the 
cost  of  the  program.  The  study  also  concludes  that  the  cost 
effectiveness  of  cervical  cancer  screening  is  much  more  af- 
fected by  the  cost  assigned  to  screening  then  by  different 
assumptions  of  the  precise  error  and  discount  rates. 

The  cost  effectiveness  of  screening  at  each  simulated  in- 
terval was  compared  to  no  screening  for  a  10-year  period. 
Efficacy  information  was  addressed  and  different  test  error 
rates  were  used.  The  production  of  the  Pap  test  was  simu- 
lated, for  cost  purposes,  at  two  levels:  an  expensive  univer- 
sity hospital  clinic  using  specialists,  and  an  inexpensive 
health  clinic  using  licensed  nurses.  Only  lives  and  years  of 
life  saved  were  identified  as  benefits. 

Costs  were  distinguished  from  charges,  marginal  costs 
were  considered,  and  indirect  costs  are  used.  Discounting 
of  costs  and  benefits  was  done  (rates  tested:  0,  5,  8  to  12 
percent),  and  sensitivity  analysis  was  performed;  however, 


issues  of  equity  were  not  directly  considered  in  the 
analysis. 

Luft,  H.,  "Benefit-Cost  Analysis  and  Public  Policy 
Implementation:  From  Normative  to  Positive  Anal- 
ysis," Pub.  Pol.  24:437,  fall  1976. 

The  author  argues  that  conventional  CBA  and  CEA 
should  be  extended  to  include  a  predictive  analysis  of  the 
implementation  phase  in  order  to  determine  whether  and 
how  the  project  will  be  done.  The  predictive  analysis  in- 
volves three  steps:  1)  a  standard  CBA  to  determine  wheth- 
er the  project  should  be  undertaken;  2)  a  CBA  from  the 
perspective  of  each  decisionmaker  or  interest  group  capa- 
ble of  influencing  the  success  of  the  project  to  determine 
the  likelihood  that  the  project  will  be  undertaken;  3)  a  re- 
design of  the  project  or  the  development  of  incentives  to 
improve  the  likelihood  of  success  for  socially  desirable 
projects. 

In  a  case  study  of  a  surgicenter,  it  is  noted  that  the  result- 
ant shifting  of  a  revenue  from  one  set  of  providers  to 
another,  though  only  a  pecuniary  externality  in  standard 
benefit-cost  analysis,  has  a  substantial  impact  on  the  likeli- 
hood that  a  surgicenter  will  actually  be  implemented.  The 
importance  of  identifying  decisionmakers  and  their  respec- 
tive power  to  influence  the  success  of  the  project  is  dis- 
cussed. The  author  points  out  that  in  the  second  step  of  the 
analysis  (the  "interest-group  analysis"),  transfer  payments, 
taxes,  and  pecuniary  externalities  should  be  explicitly  con- 
sidered, so  that  the  financial  flows  as  perceived  by  the  rele- 
vant interest  groups  are  adequately  represented.  In  addi- 
tion, it  may  be  appropriate  to  use  substantially  different 
discount  rates  for  each  interest  group.  The  final  step  in  the 
interest-group  analysis  is  to  estimate  each  group's  utility 
function  and  the  group's  relative  power  to  either  promote 
or  block  implementation  of  the  project. 

Luft  presents  an  application  of  predictive  analysis  to  the 
use  of  a  work  evaluation  unit  for  ascertaining  functional 
work  capacity  following  a  myocardial  infarction.  The  rele- 
vant interest  groups  in  this  analysis  include  the  patient, 
family,  physician,  employer,  insurer,  and  society.  Luft 
estimates  both  the  likely  net  effects  on  each  interest  group 
of  using  the  work  evaluation  unit  and  each  group's  relative 
weight.  The  author  concludes  that  this  extended,  positive 
form  of  benefit-cost  analysis  can  improve  the  allocation  of 
resources  by  helping  to  promote  the  implementation  of  de- 
sirable and  feasible  programs  and  "to  prevent  the  adoption 
and  implementation  of  proposals  that  appear  promising  in 
theory  but  are  likely  to  be  sabotaged  in  practice." 

McNeil,  B.,  et  al.,  "Measures  of  Clinical  Efficacy: 
Cost-Effectiveness  Calculations  in  the  Diagnosis  and 
Treatment  of  Hypertensive  Renovascular  Disease," 
N.  Eng.  J.  Med.  293:216,  July  31, 1975. 

The  authors  measure  the  value,  in  terms  of  sensitivity 
and  specificity,  of  intravenous  pyelography  and  radiohip- 
puran  renography  as  diagnostic  screening  methods  for  hy- 
pertension caused  by  renovascular  disease.  Costs  associ- 
ated with  both  diagnosis  and  subsequent  surgical  treat- 
ment are  also  calculated.  Financial  costs  of  the  diagnostic 
procedures  are  based  on  the  Massachusetts  Relative  Value 
Scale;  hospital  and  operation  costs  are  based  on  1974 


Appendix  C — Abstracts  of  Selected  Entries  From  the  Bibliography  on  CEA/CBA  •  209 


charges  at  Peter  Bent  Brigham  Hospital.  Three  aspects  of 
cost-effectiveness  in  the  management  of  renovascular  hy- 
pertension are  examined:  1)  the  financial  costs  of  case- 
finding  in  relation  to  the  sensitivity  and  specificity  of  both 
diagnostic  procedures;  2)  the  total  dollar  cost  of  screening 
the  American  hypertensive  population,  of  making  a  defini- 
tive diagnosis,  and  of  performing  corrective  operations; 
and  3)  the  life  and  dollar  cost  of  each  surgical  cure.  The 
cost  of  case-finding  is  found  to  be  approximately  $2,000 
per  positive  diagnosis  when  only  one  diagnostic  examina- 
tion is  used  for  screening.  This  figure  rises  to  $2,600  to 
$4,400  when  both  procedures  are  employed.  The  total 
costs  of  screening  all  patients  with  hypertension,  perform- 
ing arteriography  on  those  with  positive  tests,  and  operat- 
ing on  all  patients  with  renovascular  disease  amounts  to 
$10  billion  to  $13  billion.  The  authors  note  that  this  esti- 
mate does  not  include  the  costs  of  initial  identification  of 
all  hypertensive  Americans.  Thus,  the  authors  estimate  a 
cost  of  $15,000  to  $20,000  per  cure,  and  note  that  there  are 
15  deaths  for  every  100  surgical  cures.  The  cost-effective- 
ness calculations  are  not  sensitive  to  varying  the  assump- 
tions regarding  the  prevalence  of  renovascular  disease  in 
hypertension  patients  from  10  to  5  percent. 

Neuhauser,  D.,  "Elective  Inguinal  Herniorrhaphy 
Versus  Truss  in  the  Elderly,"  in  Cost,  Risks,  and  Ben- 
efits of  Surgery,  edited  by  J.  P.  Bunker,  et  al.  (New 
York,  N.Y.:  Oxford  University  Press,  1977). 

This  CEA  reviews  available  data  in  order  to  see  what  ef- 
fect the  choice  of  elective  herniorrhaphy  v.  truss  has  on  the 
life  expectancy  of  a  65-year-old  person.  The  analysis  in- 
cludes a  calculation  of  the  average  effects  of  1)  having  an 
immediate  elective  herniorrhaphy  (with  its  low  mortality, 
but  the  risk  that  the  hernia  will  recur  and  require  addi- 
tional elective  operations);  and  2)  using  a  truss  (with  its  at- 
tendant risk  of  obstruction,  followed  by  an  emergency  op- 
eration with  a  high  mortality  rate).  Using  data  obtained 
from  the  relevant  literature,  the  author  estimates:  1)  the 
mortality  rates  associated  with  (a)  elective  and  (b)  emer- 
gency surgery,  2)  the  probability  of  recurrence  of  the  her- 
nia after  an  operation,  3)  the  yearly  probablity  of  strangu- 
lation, and  4)  the  life  expectancy  of  the  patient.  Two  sets  of 
numbers  are  used  in  the  analysis.  The  first  set  of  numbers 
serves  as  a  conservative  test  of  the  hypothesis  that  the  truss 
prolongs  life,  because  the  values  in  this  set  are  those  which 
systematically  place  the  benefit  of  the  doubt  in  a  direction 
favorable  to  the  elective  operation.  The  numbers  in  the  sec- 
ond set  are  based  on  what  seem  to  be  the  most  reasonable 
and  reliable  data.  (The  author  notes  that  there  are  insuffi- 
cient data  to  consider  a  "do  nothing"  third  alternative.) 

The  model  takes  the  form  of  a  decision  tree,  which  is  de- 
signed so  that  the  "payoffs"  equal  the  expected  value  of  the 
average  number  of  life-years  lost.  The  results  of  the  con- 
servative test  (used  because  it  makes  the  strongest  case  for 
the  elective  operation,  which  is  standard  of  surgical  prac- 
tice uniformly  proposed  by  current  surgical  literature) 
indicate  that  the  elective  operation  has  a  higher  loss  of  life 
associated  with  it  for  the  65-year-old  than  the  truss  does. 
The  test  using  the  "most  reasonable"  estimates  indicates 
that  the  elective  operation  has  a  mortality  rate  5.5  times 


greater  than  the  truss.  This  large  relative  difference,  how- 
ever, translates  into  an  absolute  difference  of  only  14.29 
days.  The  author  notes  that  in  view  of  this  small  absolute 
difference  in  mortality,  the  issue  of  quality  of  life  becomes 
important.  The  article  continues  with  a  discussion  of  this 
type  of  adjustment,  but  no  quality-of-life  adjustments  on 
the  analysis  data  are  attempted.  The  magnitude  of  the  costs 
involved  in  the  elective  operation  is  noted,  but  a  detailed 
analysis  is  not  presented.  On  the  basis  of  this  study,  the 
author  observes  that  medicare  funds  expended  on  elective 
herniorrhaphy  serve,  if  anything,  not  to  increase  life  ex- 
pectancy, but  rather  to  improve  the  quality  of  life.  He 
asks,  therefore,  if  these  funds  might  better  serve  to  im- 
prove the  quality  of  life  for  the  elderly  in  some  other  way 
(such  as  in  reducing  subway  fares  for  the  elderly). 

Neuhauser,  D.,  and  Lewicki,  A.,  "What  Do  We  Gain 
From  the  Sixth  Stool  Guaiac?"  N.  Eng.  J.  Med.  293: 
226,  July  31,  1975. 

This  article  examines  the  costs  and  effects  of  the  sixth  se- 
quential stool  guaiac  for  screening  asymptomatic  colonic 
cancer.  An  analysis  of  the  expenditures  concludes  that 
costs  rise  exponentially,  so  the  marginal  cost  of  the  sixth 
test  may  be  20,000  times  the  average  cost.  In  addition,  data 
indicate  that  there  is  little  gain  in  the  true  positive  rate 
from  testing  beyond  the  second  guaiac  examination.  Thus, 
the  cost  per  true  positive  becomes  gigantic.  The  marginal 
cost  is  decreased  with  lower  test  sensitivity  and  increased 
with  lower  prevalence  of  colonic  cancer.  The  authors  con- 
clude that  defining  a  high-risk  group,  which  would  serve  to 
lower  marginal  cost,  is  essential  to  justify  such  screening 
programs  in  a  world  of  constrained  resources. 

Neutra,  R.,  "Indications  for  the  Surgical  Treatment 
of  Suspected  Acute  Appendicitis:  A  Cost-Effective- 
ness Approach,"  in  Costs,  Risks,  and  Benefits  of  Sur- 
gery, edited  by  J.  P.  Bunker,  et  al.  (New  York,  N.Y.: 
Oxford  University  Press,  1977). 

This  article  presents  a  quantitative  approach  to  the  costs 
and  benefits  associated  with  the  "interventionist"  and 
"noninterventionist"  management  of  suspected  appendici- 
tis. The  assessment  considers  lives,  postoperative  disabil- 
ity, and  economic  costs.  Since  the  author  relied  on  the 
rather  scanty  data  from  the  available  literature  and  on 
many  simplifying  assumptions,  however,  he  cautions  that 
the  analysis  should  be  viewed  as  "paradigmatic  rather  than 
definitive."  The  analysis  addresses  the  question  of  when  to 
operate,  not  alternative  strategies,  such  as  a  dietary  pre- 
vention program  or  antibiotic  therapy. 

On  the  basis  of  two  symptoms  (location  and  severity  of 
pain)  and  two  signs  (presence  of  right  lower  quadrant  re- 
bound tenderness  and  rectal  tenderness),  an  "appendicitis 
risk  score"  was  developed.  Twenty-four  symptom  combi- 
nations were  developed  and  the  probability  of  appendicitis 
for  each  combination  was  determined  and  ranked. 

For  example,  the  highest  rank  (24)  corresponds  to  the 
combination  of  right  lower  quadrant,  severe  pain  with  re- 
bound, and  rectal  tenderness.  Assumptions  are  presented 
regarding:  1)  the  distribution  of  cases  and  noncases  of  ap- 
pendicitis along  the  risk  scale,  2)  the  prevalence  of  cases 
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and  noncases,  and  3)  the  net  costs  of  the  false  negatives  and 
false  positives  in  terms  of  mortality,  convalescence,  and  di- 
rect hospital  costs.  Two  analyses  are  performed,  one  as- 
suming that  100  percent  of  the  appendicitis  patients  on 
whom  surgery  is  not  performed  will  perforate,  the  other 
assuming  that  30  percent  will  perforate.  The  results  indi- 
cate that  a  surgeon  can  ensure  an  acceptable  mortality  rate 
by  taking  an  "interventionist"  approach,  but  only  at  the 
cost  of  increasing  convalescent  days  and  hospital  costs.  Re- 
laxing the  indications  for  surgery  to  include  patients  who 
lack  the  most  obvious  symptoms  saves  lives,  but  at  an  ever 
diminishing  rate.  The  few  lives  saved  by  operating  on  pa- 
tients with  minimal  symptoms  are  purchased  at  great  costs 
in  convalescence  and  dollars  associated  with  the  removal 
of  large  number  of  normal  appendices.  The  author  sug- 
gests a  solution  to  this  dilemma — namely,  increasing  dis- 
crimination by  using  very  complete  diagnostic  information 
and  careful  clinical  interpretations.  Increased  discrimina- 
tion can  reduce  the  removal  rate  of  normal  appendices 
without  an  increase  (and  possibly  with  a  decrease)  in  the 
rate  of  perforation.  The  author  estimates  the  possible  sav- 
ings in  lives,  convalescence,  and  money  that  may  result 
from  an  increase  in  discrimination. 

Office  of  Technology  Assessment,  U.S.  Congress,  A 

Review  of  Selected  Federal  Vaccine  and  Immuni- 
zation Policies,  GPO  stock  No.  052-003-00701-1 
(Washington,  D.C.:  U.S.  Government  Printing  Of- 
fice, September  1979). 

This  study  includes  an  examination  of  the  cost  effective- 
ness (CE)  of  applying  a  primary  preventive  technology — 
vaccination  against  pneumococcal  pneumonia — to  differ- 
ent age  groups.  Medical  care  costs  and  health  effects 
associated  with  a  preventive  program  are  explored  from 
the  perspectives  of  society  and  of  a  third-party  payer  such 
as  medicare. 

A  CEA  was  used  to  calculate  the  expected  change  in 
health  effects  and  medical  costs  from  vaccination  against 
pneumococcal  pneumonia — an  alternative  compared  to 
continuing  the  present  situation  in  which  pneumococcal 
pneumonia  is  treated  if  it  occurs.  In  the  analysis,  costs 
were  limited  to  expenditures  and  savings  within  the  medi- 
cal care  sector,  and  changes  in  health  status  were  expressed 
in  years  of  healthy  life.  Thus,  the  cost-effectiveness  ratio 
represented  the  net  medical  cost  per  year  of  healthy  life 
that  would  be  gained  by  a  vaccinated  person.  The  calcu- 
lations were  based  on  a  single  hypothetical  vaccination 
program  conducted  in  June  1978.  The  analysis  used  a 
simulation  model  to  estimate  the  costs  and  effects  that 
would  result  from  1978  to  2050  for  two  closed  populations, 
one  vaccinated  and  the  other  unvaccinated.  Costs  and  ef- 
fects were  discounted  at  5  percent  per  year.  Separate  cost- 
effectiveness  ratios  were  calculated  for  five  different  ages: 
2  to  4  years,  5  to  24  years,  25  to  44  years,  45  to  64  years, 
and  65  years  and  older.  The  analysis  employed  a  sensitivi- 
ty analysis  to  test  the  effect  on  the  results  of  varying  the 
values  of  several  uncertain  parameters  over  reasonable 
ranges. 

Net  health  effects  were  expressed  in  quality-adjusted  life 
years  (QALYs).  Mortality  rates  for  pneumonia  as  an  un- 


derlying cause  of  death  provided  by  the  National  Center 
for  Health  Statistics  (NCHS)  formed  the  basis  for  estimat- 
ing 1978  pneumonia  mortality  among  the  unvaccinated. 
Unpublished  age-specific  data  from  the  Health  Interview 
Survey  conducted  by  NCHS  was  used  to  estimate  the  days 
of  pneumonia  morbidity  among  the  unvaccinated. 

Medical  care  costs,  expressed  in  dollars,  included  addi- 
tional expenditures  for  vaccinations  and  for  treatment  of 
vaccine  side  effects;  reduced  expenditures  for  treating 
pneumococcal  pneumonia  that  would  be  expected  to  occur 
without  vaccination;  and  additional  expenditures  for  other 
illness  in  the  extended  years  of  life  gained  by  vaccinees  who 
avoid  death  from  pneumococcal  pneumonia.  Unpublished 
age-specific  data  from  the  Hospital  Discharge  Survey  and 
the  National  Ambulatory  Care  Survey  of  NCHS  was  used 
to  construct  estimates  of  the  costs  of  treating  pneumonia. 

The  study  found  that,  given  the  range  of  factors  in- 
volved, vaccinations  would  entail  positive  medical  expend- 
itures for  every  age  group  and  would  be  most  cost  effective 
for  those  65  years  or  older.  The  cost-effectiveness  ratio  was 
about  $4,800  per  QALY  gained  for  all  ages  and  $1,000  per 
QALY  for  ages  65  and  older.  The  analysis  found  that  vac- 
cination of  21.5  percent  of  the  population  65  years  and 
older  would  result  in  a  net  cost  to  society  of  about  $23  mil- 
lion and  would  yield  about  22,000  QALYs  over  the  life- 
times of  those  vaccinated.  The  study  also  concluded  that 
vaccination  for  all  age  groups  in  the  population  would 
have  a  net  cost  of  about  $150  million  for  a  gain  of  31,000 
QALYs. 

The  study  also  examines  policy  implications  of  these 
findings,  including  a  possible  change  in  the  medicare  law 
to  permit  Federal  payment  for  pneumococcal  vaccine  for 
the  elderly. 

Pauker,  S.,  and  Kassirer,  J.,  "Therapeutic  Decision- 
Making:  A  Cost-Benefit  Analysis,"  N.  Eng.  J.  Med. 
293:229,  July  31,  1975. 

In  this  article,  a  mathemetical  relationship  is  derived  be- 
tween the  benefits  and  costs  of  a  treatment  in  a  given  dis- 
ease and  the  threshold  level  of  clinical  suspicion  of  the  dis- 
ease. When  the  probability  of  a  patient's  illness  exceeds 
this  threshold  level,  the  better  choice  is  to  administer  treat- 
ment; when  the  probability  is  below  the  threshold,  the  bet- 
ter choice  is  to  withhold  treatment.  The  benefit  equals  the 
net  benefit  of  appropriate  treatment  and  is  calculated  as  the 
difference  between  the  utility  of  administering  treatment 
and  the  utility  of  withholding  treatment  from  patients  who 
could  benefit  from  it.  The  cost  is  the  net  cost  of  unneces- 
sary therapy  and  is  calculated  as  the  difference  between  the 
utility  of  avoiding  treatment  and  the  utility  of  administer- 
ing treatment  to  those  who  do  not  have  the  disease.  Using 
probabilities,  the  authors  develop  equations  expressing  the 
expected  values  of  treatment  and  no  treatment.  The  point 
of  indifference  as  to  course  of  action  is  where  the  expected 
value  of  treatment  equals  the  expected  value  of  no  treat- 
ment. The  probability  value  at  the  indifference  point  is  the 
threshold  level.  Using  this  concept  in  a  clinical  setting  re- 
quires assessing  the  probability  of  the  disease  in  a  given  pa- 
tient and  determining  whether  it  is  above  or  below  the 
threshold  level.  A  unique  threshold  value  must  be  calcu- 
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lated  for  each  disease  and  its  treatment  in  a  given  cohort  of 
patients  (defined  as  having  common  risk  characteristics). 
Sensitivity  analysis  may  be  employed  when  significant  un- 
certainty surrounds  the  probabilities  and  utilities  involved 
in  the  calculations.  In  addition,  if  the  clinical  status  of  the 
patient  or  if  the  circumstances  of  administration  of  the 
therapy  differ  notably  from  the  typical  case,  the  benefits 
and/ or  costs  must  be  adjusted  appropriately. 

Rettig,  R.  A.,  "Formal  Analysis,  Policy  Formulation, 
and  End-Stage  Renal  Disease,"  in  The  Implications  of 
Cost-Effectiveness  Analysis  of  Medical  Technology/ 
Background  Paper  #2:  Case  Studies  of  Medical  Tech- 
nologies, prepared  by  OTA,  U.S.  Congress  (Wash- 
ington, D.C.:  in  press,  1980). 

This  paper  examines  the  role  of  formal  analysis  in  Feder- 
al decisionmaking  related  to  end-stage  renal  disease  rather 
than  that  of  CEA  per  se.  The  study  places  special  emphasis 
on  institutional  factors  encouraging  or  inhibiting  the  use  of 
formal  analyses.  These  are  defined  as  "any  explicitly  ana- 
lytical means  of  systematically  examining  the  social  costs 
and  benefits  of  alternative  policies  for  the  purpose  of 
choosing  a  preferred  alternative  in  light  of  an  a  priori  nor- 
mative decision  rule."  CEA  and  CBA  fit  this  definition,  as 
do  risk-benefit  and  cost  analyses. 

The  case  study  presents  information  on  patients  with 
end-stage  renal  disease.  The  author  notes  that  the  propor- 
tion of  men  in  the  total  patient  population  on  dialysis  de- 
clined between  1970  and  1976.  The  average  age  of  dialysis 
patients  increased,  and  the  proportion  of  home  dialysis  pa- 
tients declined  from  40  percent  in  1972  to  24  percent  in 
1976.  The  number  of  dialysis  patients  in  the  medicare  pro- 
gram has  risen  from  14,000  in  1973  to  50,000  in  1978. 

The  paper  deals  primarily  with  the  impact  of  two  formal 
analyses  of  end-stage  renal  disease  issued  in  1967:  1)  the 
"Gottschalk  report,"  prepared  by  an  expert  advisory  com- 
mittee for  the  Bureau  of  the  Budget;  and  2)  the  "Burton 
report,"  prepared  by  a  Public  Health  Service  task  force  for 
the  U.S.  Surgeon  General.  (The  paper  mentions  several 
other  formal  analyses  but  focuses  on  these  two.)  The 
author  describes  policy-related  and  institutional/bureau- 
cratic factors  that  led  to  the  conduct  of  these  formal 
analyses  and  that  affected  the  form  the  analyses  took  along 
with  many  of  their  methodological  assumptions.  The 
author  also  describes  and  summarizes  the  results  of  the 
CEA  in  the  Gottschalk  report  and  of  the  "costs  and 
benefits"  analysis  in  the  Burton  report. 

The  author  then  addresses  the  effects  of  both  reports. 
The  Gottschalk  report,  for  example,  led  the  Bureau  of  the 
Budget  to  fund  a  Veterans  Administration  (VA)  adminis- 
tered hemodialysis  program  that  included  a  substantial 
portion  of  the  VA  dialysis  patients.  The  Burton  report,  ac- 
cording to  the  author,  had  no  direct  program  effects. 

On  the  whole,  this  study  suggests  that  formal  analysis 
"did  not  affect  the  fact  that  the  policy  choice  was  a  basic 
political  choice."  Yet  the  paper  also  notes  that  the  analyses 
may  have  raised  the  consciousness  of  high  level  policy- 
makers as  to  cost  implications.  The  paper  also  mentions 
some  of  the  factors  that  limit  the  effect  of  analysis  such  as 
inadequate  data,  lack  of  access  of  analysts  to  decisionmak- 


ers, and  difficulties  in  making  assumptions  that  frame  the 
problem. 

Saxe,  L.,  The  Implications  of  Cost-Effectiveness 
Analysis  of  Medical  Technology/ Background  Paper 
#3:  The  Efficacy  and  Cost-Effectiveness  of  Psycho- 
therapy, prepared  by  OTA,  U.S.  Congress  (Wash- 
ington, D.C.:  in  press,  1980). 

This  case  study  prepared  by  Leonard  Saxe,  was  based  on 
a  document  prepared  for  OTA  by  Brian  Yates  and  Freder- 
ick Newman.  It  describes  a  variety  of  methodological  and 
substantive  problems  that  arise  in  assessing  the  effects  of 
mental  health  treatments.  The  report  both  summarizes  the 
existing  literature  and  attempts  to  present  the  divergent 
perspectives  within  the  research-policy  community  con- 
cerned with  psychotherapy.  As  described  below,  it  deals 
with  four  issues  that  are  centrally  related  to  the  evaluation 
of  psychotherapy. 

Definition.  Psychotherapy  is  not  a  simple  intervention, 
and  part  of  the  confusion  about  its  effectiveness  has  to  do 
with  reviewers'  use  of  different  definitions.  The  present 
report  uses  a  relatively  broad  definition  of  psychotherapy 
in  order  to  best  represent  current  therapy  practice.  This 
definition  includes  treatments  based  on  Freudian  ideas 
about  psychodynamics,  as  well  as  newer  therapies  based 
on  theories  of  learning  and  cognition.  The  report  also  notes 
that  psychotherapies  are  not  distinguishable  only  by  their 
theoretical  bases.  In  addition,  patient  variables  (e.g.,  in- 
telligence), therapist  variables  (e.g.,  empathy),  and  the 
nature  of  the  treatment  setting  affect  the  nature  of  psycho- 
therapy. Although  the  inclusion  of  such  factors  makes  the 
analysis  of  psychotherapy  more  difficult,  there  seems  to  be 
ample  evidence  as  to  the  importance  of  these  factors  on  the 
outcome. 

Assessibility .  Although  psychotherapy  itself  is  complex 
and  there  is  no  clearly  agreed  upon  way  of  viewing  it,  the 
methods  for  assessing  psychotherapy  seem  better  estab- 
lished. The  report  describes  the  variety  of  experimental 
and  quasi-experimental  designs  that  have  been  used  in 
assessing  psychotherapy,  along  with  an  analysis  of  what 
types  of  information  can  be  obtained  by  application  of 
these  techniques.  The  report  also  describes  and  analyzes 
various  methodological  strategies  for  measuring  the  out- 
comes of  psychotherapeutic  treatment  and  the  ways  in 
which  the  reliability  and  validity  of  measures  are  estab- 
lished. Unfortunately,  research  practice  does  not  always 
meet  these  standards.  Some  explanations  offered  in  the  re- 
port include  the  difficulties  of  withholding  treatment  and 
the  problems  of  assessing  effects  over  time.  The  report  also 
considers  the  recent  development  of  systematic  procedures 
for  synthesizing  the  findings  of  multiple  investigations. 
The  problems  of  such  techniques,  as  well  as  their  promise 
for  detecting  valid  trends  in  the  research  literature,  are 
analyzed. 

Efficacy.  The  report  describes  some  of  the  plethora  of  re- 
search which  has  been  conducted  on  psychotherapy.  The 
focus  of  the  report's  efficacy  analysis  is  a  discussion  of  six 
important  earlier  reviews  of  the  psychotherapy  literature. 
In  addition,  many  of  the  evaluative  studies  themselves 
were  reviewed.  Despite  some  fundamental  differences, 
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both  in  the  criteria  they  develop  for  assessing  psychother- 
apy and  the  studies  they  include  for  review,  the  reviews  all 
seem  to  support  the  findings  that  (under  specified  condi- 
tions) there  is  evidence  as  to  psychotherapy 's  effectiveness. 
In  fact,  with  the  exception  of  reviews  that  focus  on  psycho- 
analytically  oriented  therapies,  there  seems  to  be  little  neg- 
ative evidence  as  to  efficacy  of  such  treatments.  Although 
it  is  difficult  to  make  global  statements,  the  evidence  seems 
more  supportive  of  psychotherapy  than  of  any  alternative 
hypothesis  (spontaneous  remission,  placebo  effects).  How- 
ever, there  is  a  great  need  for  well-conducted  research 
which  evaluates  psychotherapy  for  specific  disorders  under 
specified  treatment  conditions.  This  research  would  need 
to  be  carried  out  in  actual  delivery  settings. 

Cost  effectiveness.  The  application  of  CEA/CBA  to  psy- 
chotherapy is  much  more  recent,  and  hence  less  developed 
than  efficacy  research.  Nevertheless,  a  number  of  models 
are  available  for  conducting  such  analyses.  In  general,  the 
models  are  based  on  those  used  in  other  applications  of 
CEA/CBA,  and  the  problems  engendered  by  their  use  are 
similar.  A  particular  concern  with  such  psychotherapy 
assessments  is  whether  costs  and  benefits  can  be  com- 
prehensively measured.  Thus,  for  example,  although  the 
costs  of  psychotherapy  treatment  are  relatively  easy  to 
measure,  it  is  more  difficult  to  determine  and  quantify 
what  type  of  benefit  has  been  achieved.  Much  of  the 
CEA/CBA  research  to  date  has  involved  a  comparison  of 
psychotherapy  treatments.  Although  such  research  indi- 
cates the  potential  use  of  CEA/CBA  to  improve  the  func- 
tioning of  clinical  settings  where  psychotherapy  is  given, 
its  use  for  policymaking  is  less  clear.  Such  work  seems  pos- 
sible, however,  and  may  potentially  be  incorporated  as 
part  of  large-  scale  efficacy  assessments. 

Schachter,  K.,  and  Neuhauser,  D.,  "Surgery  for 
Breast  Cancer,"  in  The  Implications  of  Cost-Effec- 
tiveness Analysis  of  Medical  Technology /Back- 
ground Paper  #2:  Case  Studies  of  Medical  Technol- 
ogies, prepared  by  OTA,  U.S.  Congress  (Washing- 
ton, D.C.:  in  press,  1980). 

This  study  is  an  examination  of  the  scientific  and  techni- 
cal issues  that  are  part  of  the  debate  over  the  appropriate 
approach  to  detecting  and  treating  breast  cancer.  The  ma- 
jor focus  of  the  analysis  is  devoted  to  the  review,  discus- 
sion, and  evaluation  of  the  various  types  of  surgical  and 
nonsurgical  procedures  used  to  treat  breast  cancer.  Cost- 
effectiveness  considerations,  however,  are  not  totally  ig- 
nored. The  authors  note  that  the  resolution  of  the  detection 
and  treatment  issues  will  have  major  cost  and  benefit  im- 
plications. The  authors  also  perform  a  hospital  cost  analy- 
sis of  two  different  treatment  strategies — inpatient  versus 
outpatient  tissue  biopsy. 

The  background  of  the  study  is  established  by  a  brief 
overview  of  the  extent  and  effects  of  breast  cancer  in 
America.  A  history  of  cancer  of  the  breast  is  presented,  as 
is  a  description  of  the  development  and  popularization  of 
the  Halsted  method  of  performing  radical  mastectomy  pro- 
cedures to  treat  breast  cancer.  Developed  in  the  late  1880's, 
the  Halsted  method  remained  the  generally  accepted  "treat- 
ment of  choice"  for  over  80  years — in  1970,  80  percent  of 


breast  cancer  patients  in  the  United  States  received  radical 
mastectomies. 

Variations  of  the  Halsted  method  and  completely  new 
approaches  to  treating  breast  cancer  (both  surgically  and 
nonsurgically  or  a  combination  of  both  techniques)  over 
the  last  two  decades  have  challenged  the  traditional 
Halsted  technique.  In  this  paper,  the  authors  examine  the 
evidence  regarding  the  efficacy,  safety,  mortality,  and 
morbidity  of  these  new  techniques,  as  well  as  that  for  the 
Halsted  method. 

The  six  treatment  procedures  they  examine  are:  1)  radi- 
cal mastectomy,  2)  extended  radical  mastectomy,  3)  modi- 
fied radical  mastectomy,  4)  simple  or  total  mastectomy, 
5)  partial  mastectomy,  and  6)  local  excision,  lumpectomy 
(or  tylectomy).  Special  emphasis  is  placed  on  reviewing  the 
status  of  the  nontraditional  methods  of  treating  breast 
cancer,  i.e.,  those  procedures  that  run  contrary  to  the 
Halsted  approach  (radical  mastectomy).  Also  discussed  are 
the  roles  of  three  American  surgeons — Dr.  Leslie  Wise,  Dr. 
George  Crile,  Jr.,  and  Dr.  Oliver  Cope — who  have  long 
advocated  and  practiced  a  more  limited  surgical  approach 
to  treating  breast  cancer.  Their  investigations  and  results 
regarding  the  success  of  using  non-Halsted  procedures  to 
treat  patients  are  examined. 

The  authors  summarize  the  debate  by  discussing  the  re- 
sults of  the  National  Cancer  Institute's  consensus  panel 
meeting  on  the  topic  of  breast  cancer  treatment  held  June  5, 
1979,  at  the  National  Institutes  of  Health.  In  essence,  the 
conclusion  was  that  much  work  is  left  to  be  done  in  evalu- 
ating the  various  techniques.  The  conference  recognized 
the  potential  of  the  nontraditional  procedures  and  the 
value  of  the  total  mastectomy  as  used  in  place  of  the  Hal- 
sted radical  procedure  for  certain  women.  More  informa- 
tion is  needed  regarding  the  efficacy  and  safety  of  the  alter- 
native procedures;  segmental  mastectomy,  primary  radio- 
therapy, etc.  Over  the  last  few  years,  the  modified  radical 
procedure  has  become  more  popular  than  the  Halsted  radi- 
cal technique,  but  there  is  still  no  general  consensus  on 
what  procedure(s)  should  be  the  treatment  of  choice. 

According  to  the  authors,  there  is  good  evidence  that 
survival  rates  are  no  better  for  the  radical  procedures  than 
for  the  less  severe  techniques  available.  Why  then  is  there 
still  adherence  to  the  more  drastic  approach?  The  authors 
set  out  a  number  of  micro  and  macro  issues  that  may  help 
explain  the  continued  reliance  on  the  Halsted  method:  cul- 
tural and  traditional  reasons,  economic  incentives,  indi- 
vidual personalities  and  reputations,  existing  logic  of 
cancer  treatment,  structure  of  the  medical  specialties, 
burden  of  proof  requirements  on  innovators  and  tradition- 
alists, medical  conservatism,  and  the  scaling  of  evidence. 

The  authors'  cost  analysis,  as  mentioned  above,  is  a 
comparison  of  the  cost  differences  of  inpatient  versus  out- 
patient tissue  biopsy.  The  authors  consider  these  alterna- 
tive strategies  in  light  of  the  number  of  cases  of  breast  sur- 
gery at  Massachusetts  General  Hospital  in  1976  and  the 
total  number  of  procedures  for  the  United  States  in  1975. 
Their  calculations  and  extrapolations  determined  that  $185 
million  (excluding  radiation  therapy)  or  a  45-percent  re- 
duction in  total  costs  would  result  per  year  if  outpatient  bi- 
opsies were  used  uniformly  and  radical  surgery  were  re- 
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placed  with  more  limited  surgery.  However,  as  the  authors 
note,  the  reader  must  realize  the  very  approximate  nature 
of  cost  analysis.  Nevertheless,  the  authors  feel  that  the 
magnitude  of  the  cost  differences  warrant  a  more  complete 
investigation. 

Scheffler,  R.  M.,  and  Delaney,  ML,  "Assessing  Se- 
lected Respiratory  Therapy  Modalities:  Trends  and 
Relative  Costs  in  the  Washington,  D.C.  Area,"  in 
The  Implications  of  Cost-Effectiveness  Analysis  of 
Medical  Technology/ Background  Paper  #2:  Case 
Studies  of  Medical  Technologies,  prepared  by  OTA, 
U.S.  Congress  (Washington,  D.C:  in  press,  1980). 

This  study  is  basically  a  cost  analysis  of  alternative 
methods  to  deliver  respiratory  therapy.  The  authors  de- 
scribe the  technology  of  respiratory  therapy,  the  indica- 
tions for  the  use  of  each  type  of  therapy,  and  the  substitut- 
ability  of  different  modalities.  The  authors  also  review  the 
literature  on  effectiveness  and  conclude  that  respiratory 
therapy's  efficacy  and  effectiveness  has  not  been  adequate- 
ly proven  and  is  still  in  dispute. 

The  paper  describes  an  empirical  survey  which  the  au- 
thors undertook  in  the  metropolitan  Washington,  D.C, 
area.  Using  data  from  that  survey,  the  authors  chart  the 
utilization  of  respiratory  therapy  techniques  by  type  of 
hospital  and  by  number  of  beds.  They  also  chart  the  trends 
in  use  from  1976  to  1979,  noting  a  shift  from  the  more  ex- 
pensive high-technology  oriented  therapy  (IPPB)  to  the  less 
expensive  simpler  aerosols  and  spirometers. 

In  their  cost  analysis,  the  authors  compare  each  type  of 
therapy  with  another.  Cost  savings  of  the  shift  in  technol- 
ogy are  estimated.  By  focusing  on  a  cost  comparison  anal- 
ysis, the  authors  implicitly  assumed  that  efficacy  and  effec- 
tiveness across  therapies  are  constant.  The  costs  of  one 
therapy  are  compared  with  those  of  the  others. 

The  adequacy  of  efficacy  and  effectiveness  information 
is  addressed  (and  found  to  be  inadequate).  Specific  benefits 
and  effectiveness  are  not  identified,  measured,  or  valued. 
Costs  are  distinguished  from  charges,  and  "avoidable,"  or 
incremental  costs  are  identified.  The  indirect  costs  (lost 
production)  are  not  identified.  Discounting  is  not  used 
(costs  are  incurred  in  the  present,  future  benefits  are  not 
projected).  Sensitivity  analysis  is  not  used,  and  issues  of 
equity  are  not  addressed.  Public  policy  considerations  are 
discussed. 

Schoenbaum,  S.,  et  al.,  "Benefit-Cost  Analysis  of 
Rubella  Vaccination  Policy,"  N.  Eng.  J.  Med.  294: 
306,  Feb.  5, 1976. 

The  authors  estimate  the  costs  and  benefits  of  various 
rubella  vaccination  strategies,  each  at  100-  and  80-percent 
compliance.  Benefits  are  the  savings  that  result  from  the 
prevention  of  both  acute  rubella  and  congenital  rubella. 
The  direct  costs  of  rubella  (and  hence  the  direct  cost  sav- 
ings from  prevention)  are  the  costs  of  medical  care,  medi- 
cation or  special  devices,  and  special  education  or  rehabili- 
tation. Indirect  costs  result  from  temporary  disability  dur- 
ing acute  illness  and  complications,  in  addition  to  deaths 
from  purpura  or  encephalitis,  and  from  permanent  disabil- 
ity that  results  from  congenital  rubella  syndrome.  The 


costs  of  rubella  vaccination  were  estimated  on  the  basis  of 
the  cost  of  measles  vaccination.  Vaccination  at  ages  10  to 
12  appears  preferable  to  vaccination  at  ages  1  to  3  for  two 
reasons:  1)  because  the  gap  between  vaccinating  and  realiz- 
ing benefits  from  prevention  of  congenital  rubella  is 
shorter  the  closer  vaccination  is  to  childbearing;  and  2) 
because  the  net  benefits  of  preventing  congenital  rubella 
are  greater  than  those  associated  with  preventing  acute 
rubella  infection.  The  latter  reason  was  demonstrated  by 
employing  conservative  assumptions:  Only  the  most  ob- 
vious abnormalities  associated  with  congenital  rubella 
were  included  in  the  analysis,  and  the  number  of  clinical 
cases  of  acute  rubella  was  probably  overestimated. 

The  results  indicate  that  the  economic  benefits  of  a 
rubella  vaccination  program,  assuming  100-percent  com- 
pliance, are  greater  if  offered  once  to  females  at  age  12 
rather  than  to  children  of  both  sexes  at  age  6  or  younger.  If 
compliance  is  80-percent  instead,  the  least  number  of 
babies  with  congenital  rubella  will  be  born  when  vaccina- 
tion is  offered  twice,  once  to  children  of  both  sexes  at  the 
age  of  2  and  again  to  females  at  the  age  of  12.  Finally,  the 
analysis  indicates  that  if  the  vaccine  is  to  be  offered  to 
children  at  or  before  age  2,  it  is  more  effective  to  use  com- 
bined measles  and  rubella  vaccine. 

A  6-percent  discount  rate  is  used  throughout  the  analy- 
sis, with  no  sensitivity  testing  done.  It  is  assumed  that 
complications  of  rubella  vaccination  in  the  age  groups 
under  consideration  are  negligible.  The  frequency  of  rubel- 
la infection  was  estimated  on  the  basis  of  two  serologic 
surveys. 

Schoenbaum,  S.,  et  al.,  "The  Swine-Influenza  Deci- 
sion," N.  Eng.  ].  Med.  295:  759,  Sept.  30,  1976. 

This  CBA  examines  alternative  strategies  for  a  swine  in- 
fluenza vaccination  program.  The  benefits  of  a  vaccination 
program  are  described  as  the  product  of  the  direct  and  in- 
direct costs  that  would  be  incurred  in  the  event  of  an 
epidemic,  the  probability  of  an  epidemic,  and  vaccine  ef- 
ficacy. The  costs  involved  in  the  program  include  those 
associated  with  vaccine  production  and  administration, 
resultant  complications,  and  intangibles.  Both  private  and 
public  sector  programs  are  examined.  The  Delphi  method 
is  used  to  obtain  information  regarding  the  probability  of 
an  epidemic,  age-specific  morbidity  and  mortality  rates  for 
both  total  and  high-risk  populations,  vaccine  efficacy  and 
side  effects,  and  vaccine  acceptance  rates.  The  net  benefits 
for  three  strategies,  which  vary  by  age  and  risk  of  the 
target  population,  are  calculated.  The  probability  of  an 
epidemic,  vaccine  efficacy,  and  vaccine  acceptance  rates 
are  subjected  to  sensitivity  analysis.  The  three  strategies 
under  consideration  were  found  to  be  sensitive  to  accept- 
ance rates.  The  results  of  the  analysis  indicate  that  ex- 
pected net  benefits  are  not  maximized  by  the  vaccination  of 
everyone  over  5  years  of  age.  A  policy  of  orienting  the  pro- 
gram toward  the  general  adult  population  can  be  justified 
with  low  vaccine-administration  costs,  high  vaccine  effi- 
cacy, and  high  acceptance  rates  (59  percent),  assuming  fur- 
ther that  the  flu  strain  represents  a  potential  pandemic. 
Otherwise,  only  high-risk  group  vaccination  is  warranted. 
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A  major  feature  of  this  study — both  in  its  design  and 
achievement — is  demonstration  that  a  sound,  useful  analy- 
sis can  be  initiated  and  completed  in  a  matter  of  weeks. 

Schweitzer,  S.  O.,  and  Scalzi,  C,  "The  Cost-Effec- 
tiveness of  Bone  Marrow  Transplant  Therapy  and  Its 
Policy  Implications,"  in  The  Implications  of  Cost- 
Effectiveness  Analysis  of  Medical  Technology/ Back- 
ground Paper  #2:  Case  Studies  of  Medical  Technol- 
ogies, prepared  by  OTA,  U.S.  Congress  (Washing- 
ton, D.C.:  in  press,  1980). 

The  study  is  a  CEA  of  a  highly  technical  and  very  costly 
emerging  medical  technology.  The  cost  and  effectiveness 
(lives  and  years  of  life  saved)  data  the  authors  use  were  em- 
pirically derived  from  the  Bone  Marrow  Transplant  (BMT) 
Program  at  the  University  of  California  at  Los  Angeles. 
Much  of  the  effectiveness  data  had  been  previously  pub- 
lished. Quality  of  life  data  was  collected  by  a  single 
observer,  a  BMT  Program  nurse. 

Patients  with  aplastic  anemia  and  leukemia  were  stud- 
ied. Since  there  were  insufficient  resources  to  allow  all 
eligible  patients  into  the  BMT  Program,  patients  who  re- 
ceived transplants  were  compared  to  those  who  were 
judged  eligible  but  not  selected.  The  sample  sizes  were  very 
small  and  survival  data  was  limited  to  3  years  as  a  result  of 
the  newness  of  the  technology. 

Bone  marrow  transplant  procedures  are  compared  to 
conventional  therapy,  as  opposed  to  no  treatment,  even 
though  there  is  no  indication  that  conventional  treatment 
is  efficacious.  The  cost  of  transplant  procedures  is  con- 
sidered to  be  the  incremental — or  avoidable — cost  above 
that  what  would  have  been  spent  anyway. 

Efficacy  data  is  empirically  derived  from  the  study  of  pa- 
tients admitted  to  the  program,  extrapolated  to  normal  life 
expectancy  for  "successful"  transplants  (defined  as  those 
patients  still  living  after  3  years),  and  compared  to  the 
group  of  nonselected  patients.  The  production  process  de- 
scribed and  used  in  the  analysis  is  the  one  currently  in 
place  (this  is  an  emerging  technology). 

A  wide  range  of  benefits  is  identified,  and  an  attempt  is 
made  by  the  authors  to  value  and  combine  quality  of  life 
with  projected  increase  in  life.  Hospital  charges  are  used 
for  costs,  and  incremental  costs  are  identified  and  included 
in  the  analysis.  Indirect  costs  are  also  calculated.  Discount- 
ing is  not  used  for  future  benefit  (years  of  life  saved)  valua- 
tions. All  costs  were  assumed  to  occur  in  the  present.  Sen- 
sitivity analysis  is  not  used.  Bone  marrow  transplantation 
is  still  being  employed  in  a  research  mode,  so  equity  issues 
are  mainly  relevant  to  the  patient  selection  process;  such 
issues  are  not  directly  addressed  in  this  study. 

The  results  of  the  analysis  are  expressed  as  a  cost-effec- 
tiveness ratio  (cost  per  year  of  life  saved).  The  authors  do 
not  qualify  these  results  by  discussing  the  confidence  which 
the  reader  can  place  in  them.  An  extensive  discussion  on 
the  relevance  this  study  has  to  public  policy  is  presented. 
The  cost-effectiveness  ratios  developed  for  bone  marrow 
transplant  procedures  are  compared  to  the  cost-effec- 
tiveness ratios  for  other  life-saving  programs. 


Showstack,  J.  A.,  and  Schroeder,  S.  A.,  "The  Costs 
and  Effectiveness  of  Upper  Gastrointestinal  Endo- 
scopy," in  The  Implications  of  Cost-Effectiveness 
Analysis  of  Medical  Technology /Background  Paper 
#2:  Case  Studies  of  Medical  Technologies,  prepared 
by  OTA,  U.S.  Congress  (Washington,  D.C.:  in 
press,  1980). 

This  report  examines  the  use  of  the  fiberoptic  endoscope 
to  visualize  the  upper  gastrointestinal  (UGI)  tract  from  the 
esophagus  to  the  upper  portion  of  the  small  intestine.  The 
study  covers  the  effectiveness  and  economic  costs  of  this 
common  form  of  endoscopy.  Issues  related  to  evaluating 
endoscopy's  benefits  and  costs  are  discussed,  though  no 
formal  comparison  of  costs  and  benefits  is  undertaken. 

The  authors  describe  the  technique  of  endoscopy  and  the 
device  used — the  fiberoptic  endoscope.  They  briefly  touch 
on  training  in  the  technique  and  identify  the  common  med- 
ical indications  for  endscopy's  use. 

The  report  discusses  the  clinical  effectiveness  of  UGI  en- 
doscopy, which  is  used  to  diagnose  conditions  of  the  UGI 
tract  and  to  obtain  specimens  of  tissue.  The  medical  indica- 
tions for  use  are  quite  broad  and  inclusive.  Studies  of  the 
diagnostic  value  of  the  technique  suggest  that  endoscopy 
significantly  contributes  to  the  amount  of  diagnostic  in- 
formation. Very  often,  however,  the  medical  condition  be- 
ing diagnosed  is  such  that  the  information  gained  does  not 
improve  morbidity  or  mortality  for  the  patient(s). 

The  authors  state  that  the  most  common  dangers  associ- 
ated with  endoscopy  are  perforation  (esophagus  or  stom- 
ach), bleeding,  cardiopulmonary  effects,  and  infection. 
These  complications  are  relatively  rare,  yet  not  insignifi- 
cant given  the  large  number  of  endoscopies  performed  na- 
tionally (at  least  500,000  each  year). 

The  authors  distinguish  between  the  cost  of  performing 
the  procedure  and  the  charges  for  it.  Using  data  from  Cali- 
fornia, they  provide  a  median  charge  of  $240,  and  by  ex- 
trapolation, a  total  national  expenditure  of  $122  million. 
Using  a  hypothetical  cost  analysis,  they  then  estimate  that 
the  average  cost  to  a  physician  for  performing  a  routine 
procedure  ranges  from  $41  to  $83. 

The  study  addresses  issues  in  evaluating  benefits  and 
costs  of  endoscopies.  The  authors  point  out  the  difficulties 
of  adequately  estimating  the  value  of  a  diagnostic  proce- 
dure such  as  endoscopy.  They  cite  the  difficulties  of  con- 
ducting a  clinical  trial  ethically  when  conditions  such  as 
gastric  cancer  are  involved.  They  also  cite  other  difficul- 
ties, such  as  problems  in  extrapolating  from  the  results  of 
clinical  trials  in  the  event  that  such  trials  were  conducted. 
The  authors  maintain  that  cost-effectiveness  studies  would 
be  limited  in  their  usefulness  because  of  these  difficulties  in 
assessing  benefits.  Though  theoretically  possible,  measure- 
ments of  costs  and  benefits  are  unlikely  since  such  meas- 
ures cannot  realistically  be  made  sensitive  enough  to  pro- 
vide an  accurate  and  useful  assessment  for  decisionmakers. 

The  authors  also  discuss  the  use  of  endoscopy  and  policy 
considerations,  such  as  incentives  leading  to  its  use  and  the 
regulatory  issues  involved.  Finally,  the  need  for  increased 
investigation  of  more  narrowly  defined  indications  for  use 
of  endoscopy  is  discussed. 
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Stange,  P.,  and  Sumner,  A.,  "Predicting  Treatment 
Costs  and  Life  Expectancy  for  End-Stage  Renal  Dis- 
ease," N.  Eng.  J.  Med.  298:  372,  Feb.  16,  1978. 

The  objectives  of  this  analysis  are  to  predict  the  future 
medical  care  costs  and  life  expectancy  of  patient  cohorts  in 
facility  dialysis,  home  dialysis,  and  cadaveric  transplanta- 
tion over  the  next  decade  and  to  estimate  the  cumulative 
effect  on  costs  and  life  expectancy  of  successive  1,000- 
patient  cohorts,  changing  methods  of  treatment  in  each  of 
the  10  years.  Three  treatment  transition  options  are  evalu- 
ated: 1)  facility  dialysis  to  home  dialysis,  2)  facility  dialysis 
to  cadaveric  transplantation,  and  3)  home  dialysis  to  ca- 
daveric transplantation.  Both  costs  and  life  expectancy  are 
discounted  at  a  rate  of  7  percent,  which  is  not  subjected  to 
sensitivity  analysis.  The  10-year  survival  and  cost  esti- 
mates are  obtained  through  linear  extrapolation  of  recent 
data  trends.  The  experience  of  the  cadaveric-transplan- 
tation cohort  is  predicted  for  two  survival-rate  assump- 
tions. The  low  assumption  is  based  on  rates  reported  in 
1976,  and  the  high  assumption  is  an  estimate  of  the  average 
survival  rates  that  will  be  experienced  nationally  over  the 
next  10  years.  The  results  of  the  first  phase  of  the  analysis 
indicate  that,  over  the  next  decade,  each  of  the  dialysis 
cohorts  is  predicted  to  have  more  added  years  of  life  than 
the  transplantation  group.  Though  the  predicted  number 
of  life-years  for  both  forms  of  dialysis  is  approximately 
equal  over  the  10-year  period,  treatment  for  the  home-dial- 
ysis cohort  will  cost  about  $43  million  less  than  that  for  the 
facility-dialysis  cohort.  Transplantation  is  less  costly  than 
both  forms  of  dialysis. 

The  second  phase  of  the  analysis  indicates  that  undergo- 
ing home  dialysis  instead  of  facility  dialysis  (the  first  op- 
tion) provides  approximately  the  same  life  expectancy,  but 
at  34  percent  lower  costs.  The  second  option,  moving  from 
facility  dialysis  to  transplantation,  also  results  in  a  sub- 
stantial reduction  in  costs,  but  there  is  an  accompanying 
reduction  in  life  expectancy  as  well.  The  third  option, 
moving  from  home  dialysis  to  transplantation,  has  results 
similar  to  those  of  the  second  option.  The  authors  conclude 
that  while  it  is  clear  that  there  are  potential  savings  to 
society  from  public  policies  that  encourage  patients  who 
are  able  and  willing  to  shift  from  facility  to  home  dialysis, 
an  evaluation  of  the  two  dialysis-to-transplant  options  is 
ambiguous.  Transplantation  is  less  costly  than  dialysis 
over  the  10-year  period,  but  attention  must  also  be  paid  to 
the  impact  of  the  shift  in  life  expectancy.  No  cost-effective- 
ness ratios  are  presented.  The  authors  caution  that  the  in- 
tent of  their  analysis  is  not  to  promote  any  specific  form  of 
treatment,  but  rather  to  provide  information,  such  as  the 
relative  magnitude  of  the  "tradeoffs"  between  cost  reduc- 
tion and  life  expectancy  in  each  of  the  treatment  options. 

Stason,  W.  B.,  and  Fortess,  E.,  "Cardiac  Radionu- 
clide Imaging  and  Cost-Effectiveness,"  in  The  Im- 
plications of  Cost-Effectiveness  Analysis  of  Medical 
Technology /Background  Paper  #2:  Case  Studies  of 
Medical  Technologies,  prepared  by  OTA,  U.S.  Con- 
gress (Washington,  D.C.:  in  press,  1980). 

The  authors  of  this  analysis  examine  a  considerable 
range  of  issues  that  deal  with  the  recent  growth  and  ex- 


panded use  of  cardiac  radionuclide  imaging  technology  in 
the  health  care  field.  The  areas  they  address  are  the  present 
and  potential  future  characteristics  of  the  technology;  the 
market  for  and  industry  involvement  in  cardiac  imaging 
innovations;  the  uses  and  users  of  these  procedures;  the 
clinical  efficacy  and  risks  associated  with  the  techniques; 
the  costs  and  charges  of  imaging  technology  use;  and  the 
cost  effectiveness  of  these  procedures  in  different  service 
delivery  situations. 

The  authors  point  out  that  much  of  the  rapid  diffusion 
and  use  in  this  area  is  taking  place  without  a  well-grounded 
understanding  of  the  benefits  and  limitations  of  the  various 
scanning  techniques.  To  date,  only  very  selected  patient 
populations  have  been  evaluated  out  of  a  much  broader 
spectrum  of  uses  and  techniques  available  and  in  use.  Add- 
ing to  the  uncertainty  are  the  rapid  technological  changes 
that  are  occurring  and  the  poorly  defined  target  population 
for  cardiac  scans. 

Using  the  various  suggested  clinical  indications  and  uses 
as  a  backdrop,  the  authors  estimate  that  the  potential 
target  population  for  cardiac  imaging  could  be  134  million 
people  per  year  if  all  asymptomatic  people  20  years  old 
and  over  were  scanned,  70.8  million  people  per  year  if 
routine  screening  were  limited  to  those  40  and  over,  and 
11.7  million  people  per  year  if  scans  were  restricted  to  peo- 
ple with  suspected  or  established  coronary  heart  disease. 

The  study  looked  at  these  direct  nonlabor  costs  (equip- 
ment, maintenance,  radionuclides,  etc.),  direct  labor  costs 
(personnel  needs,  training,  support  staff),  and  indirect 
costs  (overhead)  to  estimate  the  financial  costs  of  cardiac 
scanning  services.  The  authors  estimate  the  annual  fixed 
costs  of  a  model  radionuclide  laboratory  to  be  $112,300  for 
the  complete  service,  with  the  costs  of  the  various  in- 
dividual procedures  ranging  from  $258  to  $72  (there  are 
nine  different  types  of  procedures  and  two  different  types 
of  radionuclide  testing  materials  involved  in  the  range  of 
procedures  available).  Significant  variations  exist  across 
the  country  regarding  the  charges  for  the  various  pro- 
cedures. Nomenclature  and  billing  procedures/listings  are 
not  comparable  from  hospital  to  hospital.  As  a  result,  it  is 
extremely  difficult  to  determine  if  there  is  a  relative  stand- 
ard or  range  of  charges  for  these  techniques.  The  authors 
developed  a  set  of  suggested  fee  schedules  for  these  pro- 
cedures that  range  from  $405  to  $155  per  scan. 

The  medical  literature  is  examined  to  determine  if  there 
is  a  proper  role  for  scanning  techniques.  The  authors  ex- 
amine extant  studies  to  determine  what  types  of  sample 
populations  have  been  used,  the  reference  or  control 
groups  used,  the  technical  and  medical  standards  against 
which  radionuclide  procedures  were  judged,  and  the  clin- 
ical settings  in  which  the  studies  were  conducted.  In  addi- 
tion, the  authors  examine  the  risks  associated  with  these 
procedures — both  to  the  health  care  professionals  and  the 
patients — and  assess  the  value  of  the  diagnostic  informa- 
tion that  the  scans  provide  to  the  diagnosis  or  the  under- 
standing of  the  extent  of  the  disease  and  its  response  to 
treatment. 

The  authors  fit  the  many  variables  into  a  cost-effective- 
ness framework  to  conduct  a  limited  analysis  of  cardiac 
imaging  procedures.  No  discount  rate  is  employed  (the 
benefit,  costs,  and  risks  occur  in  the  present),  nor  is  a  sensi- 
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tivity  analysis  performed.  The  conclusion  is  that  "decision 
stategies  based  on  threshold  cutoff  probabilities  of  a  given 
disease(s)  are  cost  effective  compared  to  blanket  testing 
.  .  .  and  that  use  of  cardiac  imaging  appears  to  identify  ad- 
ditional surgical  candidates  at  reasonable  cost  when  com- 
pared to  exercise  tolerance  testing."  The  reasonableness  of 
these  additional  costs  will  depend,  to  a  large  extent,  on  the 
incremental  health  benefits  achieved  by  coronary  artery 
surgery. 

The  authors  identify  many  of  the  policy  issues  raised  by 
this  emerging  technology.  A  few  of  the  areas  they  discuss 
are  issues  of  reimbursement,  safety  and  efficacy  determina- 
tion, disposal  of  the  radionuclide  wastes,  clinical  standards 
and  indications  for  use,  allocation  of  resources,  and  re- 
sponsibility for  regulation  and  diffusion  of  these  proce- 
dures throughout  the  medical  community. 

Stason,  W.,  and  Weinstein,  M.,  "Allocation  of  Re- 
sources To  Manage  Hypertension,"  N.  Eng.  ].  Med. 
296:  732,  Mar.  31,  1977. 

CEA  is  applied  to  the  management  of  essential  hyperten- 
sion to  "determine  how  resources  can  be  used  most  effi- 
ciently within  programs  to  treat  hypertension  and  to  pro- 
vide a  yardstick  for  comparison  with  alternative  health-re- 
lated uses  of  the  resources."  Costs  of  treatment  consist  of 
the  lifetime  costs  of  hypertension  treatment,  costs  of  treat- 
ing diseases  that  occur  during  additional  years  of  life 
gained  by  antihypertensive  treatment,  minus  the  costs  that 
would  have  been  incurred  for  the  treatment  of  cardiovas- 
cular morbid  events  if  treatment  had  not  been  given.  Effec- 
tiveness is  calculated  in  terms  of  increased  years  of  life  ex- 
pectancy from  blood-pressure  control,  adjusted  for 
changes  in  the  quality  of  life  due  to  the  prevention  of  mor- 
bid events  and  to  the  side  effects  of  medication.  The  analy- 
sis is  p?rformed  under  three  alternative  assumptions  con- 
cerning the  proportional  reduction  of  risk  of  cardiovascu- 
lar events  and  death  associated  with  the  reduction  of  blood 
pressure  due  to  treatment:  1)  full  benefit,  2)  half  benefit, 
and  3)  age-varying  partial  benefit. 

One  year  of  life  with  side  effects  is  taken  to  be  the  equiv- 
alent of  0.99  quality-adjusted  life  years.  A  5-percent  dis- 
count rate  is  used  throughout  the  analysis.  Sensitivity 
analysis  is  performed  on  several  critical  variables,  includ- 
ing the  discount  rate,  medical  treatment  costs,  and  the 
quality-of-life  adjustment.  In  addition,  the  effects  of  in- 
complete adherence  to  the  treatment  regimen  are 
examined. 

The  results  of  the  analysis  indicate  that  in  no  case  does 
treatment  pay  for  itself.  At  best,  only  22  percent  of  gross 
treatment  costs,  on  average,  can  be  recovered  from  savings 
in  the  treatment  of  strokes  and  heart  attacks.  However,  the 
analysis  also  indicates  that,  in  terms  of  effectiveness,  funds 
spent  to  improve  adherence  may  be  a  better  use  of  re- 
sources than  efforts  to  screen  a  maximum  number  of 
subjects. 

Steiner,  K.,  and  Smith,  H.,  "Application  of  Cost 
Benefit  Analysis  to  a  PKU  Screening  Program,"  In- 
quiry 10:34,  December  1973. 

The  authors  compare  and  contrast  the  techniques  of 
CBA  and  CEA,  stating  that  although  equally  sound  deci- 


sions may  be  reached  by  either  method,  one  of  the  two  is 
usually  better  suited  for  a  particular  problem.  The  authors 
believe  that  CBA  is  the  best  approach  for  screening  pro- 
grams, and  it  is  this  technique  that  they  subsequently  use  in 
evaluating  a  PKU  screening  program  in  Mississippi.  (PKU 
is  a  hereditary  condition  which  causes  mental  retardation 
if  not  detected  and  treated  with  a  dietary  regimen  early  in 
life.) 

The  costs  associated  with  PKU  are  classified  as  direct 
and  indirect.  Direct  costs  are  defined  in  this  study  as  the  ac- 
tual expenditures  for  medical  and  other  services  attribut- 
able to  the  disease.  Indirect  costs  are  defined  as  a  loss  of 
economic  productivity  attributable  to  the  disease.  These 
costs  serve  to  measure  the  benefits  of  a  successful  preven- 
tion program.  The  analysis  is  performed  from  both  a  retro- 
spective and  a  prospective  point  of  view.  The  retrospective 
approach  measures  the  costs  of  the  current  population  with 
PKU  and  estimates  what  the  costs  of  screening,  detecting, 
and  treatment  would  have  been.  For  this  study,  the  direct 
costs  associated  with  PKU  are  estimated  using  data  from 
three  mental  institutions  in  Mississippi.  Indirect  costs  are 
measured  by  the  loss  of  income,  under  the  assumptions 
that  the  PKU  victim  remains  incapacitated  for  life.  Detec- 
tion costs  are  based  on  estimates  of  the  incidence  of  PKU. 
The  retrospective  analysis  indicates  that  the  total  costs  of 
institutionalization  and  lost  earnings  associated  with  the 
current  Mississippi  population  with  PKU  (25  patients) 
amount  to  $2,314,595.  The  costs  of  detecting  and  treating 
the  25  patients  are  estimated  at  $1,392,668,  yielding  a  cost- 
to-benefit  ratio  of  1  to  1.66. 

The  prospective  method  calculates  the  cost  of  screening 
all  live  births  in  a  given  year  to  treating  those  found  to  be 
suffering  from  PKU.  In  this  study,  these  calculations  are 
based  on  the  1967  live  births  in  Mississippi.  Testing  the 
46,714  live  births  that  year  would  have  detected  an  aver- 
age of  1.76  PKU  cases.  The  costs  associated  with  these 
cases  amount  to  $135,062,  if  the  minimum  expected  length 
of  institutionalization  (30  years)  is  assumed,  or  $256,418, 
if  institutionalization  is  assumed  to  cover  the  normal  life 
expectancy  of  a  1-year-old  child  born  in  1967  (70.8  years). 
Program  costs  are  estimated  at  $98,518,  yielding  cost-ben- 
efit ratios  of  1  to  1.37  and  1  to  2.6,  respectively.  The 
authors  state  that  in  all  calculations,  the  detection  costs  are 
high  and  the  total  illness  costs  (i.e.,  possible  benefit)  are 
low  in  order  to  produce  conservative  results.  A  discount 
rate  of  4  percent  is  applied  to  the  lost  earnings  data,  but  not 
to  direct  or  detection  costs.  Other  than  varying  the  length 
of  institutionalization  in  calculating  the  prospective  cost- 
benefit  ratios,  the  authors  do  not  perform  sensitivity 
analysis. 

Van  Pelt,  A.,  and  Levy,  H.,  "Cost-Benefit  Analysis 
of  Newborn  Screening  for  Metabolic  Disorders,"  N. 
Eng.  J.  Med.  291:1414,  Dec.  26,  1974. 

This  article  examines  the  costs  and  benefits  of  a  Massa- 
chusetts program  designed  to  detect  inborn  errors  of  me- 
tabolism and  transport  in  newborn  infants.  The  costs, 
based  on  a  survey  of  all  hospitals  with  obstetric  and  new- 
born units  in  Massachusetts,  include  those  for  routine  spec- 
imen collection,  laboratory  analysis,  the  collection  of  addi- 
tional specimens,  confirmatory  testing,  and  followup  care 
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and  therapy.  For  fiscal  year  1972-73,  these  costs  amounted 
to  $460,638.  Benefits  are  calculated  as  the  estimated  sav- 
ings from  the  prevention  of  mental  retardation  and  other 
complications.  For  1972-73,  estimated  total  savings 
amounted  to  $825,300,  yielding  a  net  benefit  of  $364,662 
or  a  benefit-cost  ratio  of  nearly  1.8.  Indirect  costs  of 
metabolic  disorders  (such  as  reduced  economic  productivi- 
ty due  to  disability  and  premature  mortality),  which  would 
also  be  averted  as  a  result  of  a  screening  program,  are  not 
included  in  the  calculation  of  benefits.  Presumably,  the  in- 
clusion of  the  present  value  of  such  benefits,  when  con- 
sidered along  with  a  similar  future  stream  of  the  other  costs 
and  benefits  (also  discounted  to  present  value),  would 
result  in  even  higher  net  benefits. 

Wagner,  J.  L.,  "The  Feasibility  of  Economic  Evalua- 
tion of  Diagnostic  Procedures:  The  Case  of  CT  Scan- 
ning," in  The  Implications  of  Cost-Effectiveness 
Analysis  of  Medical  Technology / Background  Paper 
#2:  Case  Studies  of  Medical  Technologies,  prepared 
by  OTA,  U.S.  Congress  (Washington,  D.C.:  in  press 
1980). 

This  study  examines  the  appropriate  methodology  of 
CEA/CBA  for  diagnostic  procedures.  Following  the  devel- 
opment of  a  framework  for  analysis,  the  author  reviews 
the  literature  of  the  cost  effectiveness  of  CT  scanning, 
critically  evaluating  it  in  terms  of  the  evaluation  model. 

The  author  describes  a  theoretical  "ideal"  evaluative 
model  in  which  the  analysis  compares  alternative  diagnos- 
tic pathways,  each  of  which  begins  with  the  presentations 
of  signs  and  symptoms  and  ends  with  patient  outcomes. 
The  purpose  of  the  evaluation  is  not  to  examine  the  tech- 
nology per  se,  but  rather  to  evaluate  its  appropriate  use. 
The  author  describes  the  need  for  an  appropriate  means  to 
1)  identify  homogeneous  patient  groups,  2)  specify  diag- 
nostic pathways,  3)  measure  diagnostic  accuracy,  4)  meas- 
ure diagnostic  and  therapeutic  costs,  and  5)  specify  out- 
comes of  the  diagnostic  and  therapeutic  process. 

In  a  review  of  the  literature  on  the  economic  impact  of 
CT  scanning,  only  one  study  that  attempted  to  specify  di- 
agnostic pathways  was  identified.  Most  of  the  other  studies 
examined  the  impact  CT  has  on  diagnostic  costs  or  exam- 
ined the  cost  of  case  finding. 

Efficacy  information  is  addressed  both  for  diagnostic 
studies  in  general  and  for  CT  scanners  in  particular.  Com- 
ments regarding  the  potential  benefits  associated  with  neg- 
ative findings  are  also  included. 

Costs  are  distinguished  from  charges;  marginal,  or 
avoidable,  costs  are  recommended;  the  difficulty  of  captur- 
ing true  costs  is  discussed  extensively.  Indirect  costs  are  not 
considered.  Discounting  was  not  specifically  discussed,  ex- 
cept within  the  context  of  the  reviewed  case  studies;  where, 
in  one,  future  benefits  were  discounted.  Equity  issues  were 
not  addressed. 

Despite  major  limitations  in  applying  principles  of  eco- 
nomic evaluation  to  diagnostic  procedures,  such  evalua- 
tions are  feasible.  For  CT  scanning,  when  sufficient  de- 
mand exists  to  operate  a  scanner  at  full  capacity,  some 
specific  uses  appear  to  be  cost  effective. 


Weinstein,  M.,  "Economic  Evaluation  of  Medical 
Procedures  and  Technologies:  Progress,  Problems, 
and  Prospects,"  in  Medical  Technology,  proceedings 
of  the  Urban  Institute  Conference,  National  Center 
fo  Health  Services  Research,  West  Palm  Beach,  Fla., 
Dec.  10-12, 1978. 

This  paper  presents  a  state-of-the-art  assessment  of  CBA 
and  CEA  of  medical  procedures.  CBA/CEAs  are  defined 
and  distinguished  from  each  other.  The  author  advocates 
the  use  of  a  multiattribute  accounting  framework,  in  con- 
junction with  CEA  and  CBA,  in  which  unquantifiable  con- 
cerns, such  as  equity  and  ethical  issues,  are  considered 
along  with  the  traditional,  measurable  impacts.  The  basic 
methodological  principles  are  reviewed,  including  estima- 
tion of  event  rates,  sensitivity  analysis,  choosing  a  dis- 
count rate,  measurement  of  costs,  and  measurement  of 
benefits.  The  controversy  surrounding  the  assignment  of 
monetary  value  to  life  saving  and  health  improvement  in 
CBA  is  discussed. 

A  review  of  selected  applications,  classified  as  treat- 
ment, secondary  prevention,  screening,  and  immuniza- 
tion, is  presented.  The  author  states  that  diagnostic  proce- 
dures other  than  screening  have  not  received  much  atten- 
tion, in  part  because  of  methodologic  obstacles.  He  pre- 
dicts that  technology  evaluation  will  be  the  area  where  the 
next  major  advances  in  CEA  and  CBA  will  develop.  He 
then  discusses  current  methodologic  problems,  classified  as 
1)  the  valuation  of  multiattributed  outcomes,  2)  the  evalu- 
ation of  diagnostic  tests,  3)  the  evaluation  of  multifaceted 
technologies,  and  4)  uncertainty  concerning  efficacy,  costs, 
and  ultimate  uses  of  evolving  technology. 

The  paper  concludes  with  a  generally  optimistic  assess- 
ment of  the  prospect  for  CEA  and  CBA  in  medical  care  and 
for  overcoming  the  current  methodological  problems.  The 
author  recommends  a  multidisciplinary  approach  to  analy- 
sis, including  the  expertise  of  physicians,  engineers,  and 
economists.  He  notes  that  the  value  of  formal  economic 
analysis  lies  not  so  much  in  the  actual  results,  but  rather  in 
the  ability  of  such  analysis  to  highlight  uncertainty  and  the 
most  important  value  tradeoffs  -'nvolved  in  alternative 
policies. 

Weinstein,  M.  C,  and  Pearlman,  L.  A.,  "Case  Study 
on  Cost-Effectiveness  of  Automated  Multichannel 
Chemistry  Analyzers,"  in  The  Implications  of  Cost- 
Effectiveness  Analysis  of  Medical  Technology / Back- 
ground Paper  #2:  Case  Studies  of  Medical  Technol- 
ogies, prepared  by  OTA,  U.S.  Congress  (Washing- 
ton, D.C.:  in  press,  1980). 

This  study  illustrates  the  possible  techniques  for  evaluat- 
ing the  cost  effectiveness  of  automated  multichannel  chem- 
istry analyzers.  The  authors  also  examine  and  discuss  the 
limitations  due  to  data  deficiencies,  areas  for  future  re- 
search, and  influences  of  clinical  practice  on  the  evaluation 
of  such  analyzers. 

The  case  study  briefly  reviews  the  history  of  the  multi- 
channel clinical  chemistry  technology  and  presents  an  ana- 
lytical framework  for  evaluating  the  cost  effectiveness  of 
the  multichannel  analyzer.  The  authors  review  the  availa- 
ble data  concerning  the  costs  of  multichannel  chemistry 
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analyzers  and  examine  the  evidence  concerning  the  cost  ef- 
fectiveness of  using  the  cardiac  enzymes  and  isoenzymes  in 
the  diagnosis  of  myocardial  infarction. 

The  paper  discusses  several  important  issues  related  to 
the  clinical  efficacy  and  cost  effectiveness  of  clinical  labo- 
ratory chemical  tests.  A  prominent  example  of  such  an 
issue  is  the  potential  influences  on  physicians'  test-ordering 
behavior  that  may  be  induced  by  the  availability  of  multi- 
channel analyzers. 

Various  types  of  automated  multichannel  chemistry 
analyzers  could  be  compared  to  one  another  under  speci- 
fied circumstances.  Continuous  flow  models,  for  example, 
could  be  compared  to  discrete  sample  models  and  even  sin- 
gle channel  models  to  find  the  most  cost-effective  method 
of  running  specific  cardiac  enzyme  tests.  The  study  also 
discusses  the  cost  effectiveness  of  using  automated  multi- 
channel chemistry  analyzers  to  obtain  laboratory  values  as 
compared  to  not  obtaining  that  laboratory  value  at  all. 
Further,  the  authors  advocate  comparing  the  efficiency  of 
using  the  automated  multichannel  chemistry  analyzers 
under  varying  workloads  (i.e.,  the  number  of  tests  per- 
formed per  unit  of  time). 

The  study  addresses  the  adequacy — or  inadequacy — of 
efficacy  information.  As  usual,  such  information  is  not 
plentiful;  studies  designed  to  produce  efficacy  data  are  un- 
derway. The  authors  discuss  alternative  ways  to  use  the 
technology  in  various  forms  to  produce  the  greatest  degree 
of  efficiency.  The  authors  also  discuss  the  variability  of 
benefits  resulting  from  use  of  automated  multichannel 
chemistry  analyzers.  Potential  benefits  are  described  from 
a  societal  perspective  and  include  potential  reduced  costs 
from  reduced  incidence  of  unnecessary  hospitalization  re- 
sulting from  more  accurate  diagnostic  and  monitoring  test- 
ing. Health  benefits  would  be  measured  in  quality-adjusted 
life  years. 

Costs  are  distinguished  from  charges,  and  several  direct 
costs  are  identified,  including  those  for  nonlabor  (e.g., 
equipment,  service  and  maintenance,  reagents,  and  con- 
sumables) and  labor.  Fixed,  variable,  and  induced  costs  are 
all  addressed.  The  authors  state  that  indirect  costs  have  not 
been  adequately  studied  and  may  not  be  extensively  af- 
fected by  automated  analyzers.  Discounting  would  be  in- 
cluded in  analyses  described  in  this  case  study,  as  would 
the  use  of  sensitivity  analysis.  The  extent  to  which  sen- 
sitivity analysis  would  be  used  is  not  explained  explicitly. 

Data  results  are  not  derived  from  this  case  study;  how- 
ever, the  many  different  ways  the  CEA  could  be  conducted 
are  discussed.  Each  different  approach  would  yield  results 
of  a  different  meaning;  hence  several  caveats  would  be 
needed  for  each  approach  and  set  of  results. 

The  authors  discuss  the  potential  public  policy  implica- 
tions of  this  analysis  which  could  affect  reimbursement 
policies  regarding  laboratory  tests,  the  use  of  automated 
analyzers  by  hospitals  and  physicians,  and  the  design  of 
equipment  by  manufacturers.  No  conclusions  regarding 
the  cost  effectiveness  of  automated  multichannel  chemistry 
analyzers  can  be  drawn  from  this  study.  The  study  was  not 
designed  to  be  an  actual  assessment;  rather,  it  was  in- 
tended to  illustrate  how  a  CEA  of  automated  analyzers 
could  be  performed. 


Weinstein,  M.  C,  and  Stason,  W.,  "Foundations  of 
Cost-Effectiveness  Analysis  for  Health  and  Medical 
Practices,"  N.  Eng.  J.  Med.  296:  716,  Mar.  31,  1977 

This  article  presents  principles  of  CEA  as  applied  to  the 
allocation  of  health  care  resources.  The  authors  caution 
that  in  conducting  an  analysis,  the  objectives  of  the  actual 
decisionmaker  may  be  more  relevant  than  the  societal 
point  of  view.  Whenever  possible,  measures  of  effective- 
ness should  be  expressed  in  outcome-oriented  terms,  such 
as  length  of  life  and  quality  of  life.  Tradeoffs  between  pres- 
ent and  future  health  benefits  and  costs,  and  hence  the  use 
of  discounting,  are  discussed.  Net  health  care  costs  are  ex- 
pressed as  the  sum  of  costs  associated  with  treatment,  side 
effects,  and  increased  longevity  less  the  savings  from 
decreased  morbidity.  Net  health  effectiveness  is  expressed 
as  the  expected  number  of  quality-adjusted  life  years 
gained,  calculated  as  the  expected  number  of  unadjusted 
life  years,  adjusted  for  improvements  in  the  quality  of  life 
due  to  the  alleviation  or  prevention  of  morbidity  and  side 
effects  of  treatment.  Sensitivity  analysis  is  described,  and 
its  use  is  recommended  whenever  uncertainty  is  involved 
in  the  estimation  of  key  variables  (e.g.,  discount  rates, 
clinical  efficacy,  prevalence,  etc.).  The  article  ends  with  a 
discussion  of  the  value  and  application  of  CEA  in  health 
care  and  concludes  that  its  principle  value  is  that  it  forces 
one  to  be  explicit  about  the  beliefs  and  values  that  underlie 
allocation  decisions. 

Weisbrod,  B.,  "Costs  and  Benefits  of  Medical  Re- 
search: A  Case  Study  of  Poliomyelitis,"  /.  Polit. 
Econ.  79:  527,  May-June  1971. 

This  CBA  of  poliomyelitis  research  uses  and  expands  on 
the  benefit  calculations  first  presented  in  Weisbrod's  The 
Economics  of  Public  Health  (578).  These  calculations  com- 
prise savings  from  avoided  premature  mortality,  morbidi- 
ty, and  treatment  and  rehabilitation  costs.  The  analysis  re- 
quires an  estimation  of  1)  the  time  stream  of  research  ex- 
penditures directed  toward  poliomyelitis,  2)  the  time 
streams  of  a  number  of  forms  of  benefits  resulting  from  (or 
predicted  to  result  from)  the  application  of  the  knowledge 
generated  by  the  research,  and  3)  the  cost  of  applying  that 
knowledge. 

Using  this  information,  Weisbrod  calculates  internal 
rates  of  return  on  research  expenditure.  Savings  per  case 
prevented,  application  costs,  the  time  horizon,  and  re- 
search expenditures  are  all  subjected  to  sensitivity  analysis. 
The  internal  rates  of  return  were  found  to  be  sensitive  to 
application  costs,  varying  from  4  to  14  percent.  In  approxi- 
mating present  value  of  expenditures  and  benefits,  Weis- 
brod uses  a  discount  rate  of  10  percent.  No  sensitivity  anal- 
ysis is  performed  on  this  variable.  The  difficulties  en- 
countered in  trying  to  associate  specific  medical  research 
expenditures  with  a  particular  disease  are  discussed.  These 
include  the  fact  that  basic  research  is  often  not  directed  at  a 
specific  disease  problem  and  even  disease-specific  research 
frequently  yields  knowledge  relevant  to  the  prevention  or 
treatment  of  other  diseases.  The  data  used  here  are  esti- 
mates of  awards  for  poliomyelitis  research  from  1930  to 
1956.  Weisbrod  stresses  the  need  to  include  the  costs  in- 
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volved  in  the  application  of  new  medical  knowledge,  as 
well  as  the  costs  of  generating  it,  when  attempting  to  com- 
prehensively analyze  a  medical  research  program. 

The  article  concludes  with  an  interesting  discussion  of 
the  impact  on  private  market  allocative  efficiency  when  a 
collective  consumption  good  (e.g.,  medical  research)  re- 
quires for  its  application  a  procedure  such  as  vaccination 
which  is  provided  individually  and  from  which  nonpayers 
may  be  excluded.  Weisbrod  also  discusses  the  effects  of  ex- 
ternalities on  the  provision  of  medical  research  and  its  ap- 
plication for  contagious  diseases.  The  author  concludes 
that  when  collective  consumption  goods  require  use  of  in- 
dividual consumption  goods  for  their  application,  and 
where  these  individual  goods  produce  real  external  econo- 
mies, neither  the  nature  nor  the  extent  of  private  market  in- 
efficiency is  clear. 

Witte,  ].,  et  al.,  "The  Benefits  From  10  Years  of 
Measles  Immunization  in  the  United  States,"  Public 
Health  Rep.  90:  205,  May-June  1975. 

For  the  10-year  period  1963-72,  the  authors  estimate  the 
costs  the  Nation  would  have  sustained  without  measles  im- 


munization (i.e.,  the  benefits  of  measles  immunization) 
and  the  actual  costs  of  measles  during  that  period  in  terms 
of  illness  and  associated  resources  consumed.  The  research 
costs  of  developing  and  testing  the  measles  vaccine  are  not 
included  because  of  the  difficulty  in  identifying  them  and 
in  determining  the  share  applicable  to  the  United  States  in 
the  period  under  consideration. 

The  benefits  associated  with  the  measles  immunization 
program  considered  in  this  analysis  include  1)  savings  in 
medical  care  costs  for  services  of  physicians  and  for  long- 
term  institutional  care  for  those  who  would  have  become 
retarded,  and  2)  avoidance  of  production  losses  due  to 
morbidity  and  premature  mortality.  Program  costs  are 
those  incurred  in  vaccine  production,  distribution,  admin- 
istration, and  promotion.  The  analysis  concludes  that  the 
net  benefits  achieved  through  immunization  in  the  United 
States  totaled  $1.3  billion  for  the  period  1963-72.  A  single 
discount  rate  of  4  percent  is  used.  The  authors  assume  that 
the  national  immunization  effort  had  no  significant  effect 
on  the  demand  for  medical  care  or  on  the  size  and  composi- 
tion of  the  labor  force. 
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The  overall  OTA  assessment,  The  Implications  of 
Cost-Effectiveness  Analysis  of  Medical  Technology, 
consists  of  a  main,  policy-oriented  report  plus  five 
background  papers.  The  present  volume,  Methodo- 
logical Issues  and  Literature  Review,  is  one  of  the 
background  papers.  The  main  report  and  the  other 
background  efforts  are  briefly  described  below. 

The  main  report  examines  three  major  issues:  1) 
the  general  usefulness  of  CEA/CBA  in  decisionmak- 
ing regarding  medical  technology,  2)  the  methodo- 
logical strengths  and  shortcomings  of  the  technique, 
and  3)  the  potential  for  initiating  or  expanding  the 
use  of  CEA/CBA  in  six  health  care  programs  (reim- 
bursement coverage,  health  planning,  market  ap- 
proval for  drugs  and  medical  devices,  Professional 
Standards  Review  Organizations,  R&D  activities, 
and  health  maintenance  organizations),  and  most  im- 
portantly, the  implications  of  any  expanded  use. 

The  prime  focus  of  the  report  is  on  the  application 
of  CEA/CBA  to  medical  technology  (i.e.,  the  drugs, 
devices,  and  medical  and  surgical  procedures  used  in 
medical  care,  and  the  organizational  and  support  sys- 
tems within  which  such  care  is  provided).  With  the 
exception  of  a  background  paper  on  psychotherapy, 
the  report  does  not  address  psychosocial  medicine. 
Other  aspects  of  health,  such  as  the  environment,  are 
not  directly  covered  either.  The  findings  of  the  as- 
sessment, though,  might  very  well  apply  to  health 
care  resource  decisionmaking  in  general,  and  with 
modification,  to  other  policy  areas  such  as  educa- 
tion, the  environment,  and  occupational  safety  and 
health. 

The  main  report  contains  chapters  on  methodol- 
ogy, general  decisionmaking,  each  of  the  six  health 
programs  mentioned  above,  and  the  general  useful- 
ness of  CEA/CBA.  It  contains  appendixes  covering  a 
survey  of  current  and  past  uses  of  CEA/CBA  by 
agencies  (primarily  Federal),  a  survey  of  the  resource 
costs  involved  in  conducting  CEA/CBAs,  a  discus- 
sion of  ethical  issues  and  CEA/CBA,  and  a  brief  dis- 
cussion of  legal  issues. 

In  order  to  help  examine  the  applicability  of  tech- 
niques to  assess  the  costs  and  benefits  of  medical 
technology,  19  case  studies  were  prepared.  All  19  are 
available  individually.  In  addition,  17  of  the  cases  are 
available  collectively  in  a  volume  entitled  Back- 
ground Paper  #2:  Case  Studies  of  Medical  Technol- 
ogies. Some  of  the  cases  represent  formal  CEAs  (e.g., 
the  case  on  bone  marrow  transplants),  and  some  rep- 


resent net  cost  or  "least  cost"  analysis  (e.g.,  the  case 
on  certain  respiratory  therapies).  Other  cases  illus- 
trate various  issues  such  as  the  difficulty  of  conduct- 
ing CEA  in  the  absence  of  adequate  efficacy  and  safe- 
ty information  (e.g.,  the  case  on  breast  cancer  sur- 
gery), or  the  role  and  impact  of  formal  analysis  on 
policymaking  (e.g.,  the  case  on  end-stage  renal  dis- 
ease interventions).  The  17  case  studies  in  Back- 
ground Paper  #2  and  their  authors  are: 
Artificial  Heart 

Deborah  P.  Lubeck 

John  P.  Bunker 
Automated  Multichannel  Chemistry  Analyzers 

Milton  C.  Weinstein 

Laurie  A.  Pearlman 
Bone  Marrow  Transplants 

Stuart  O.  Schweitzer 

C.  C.  Scalzi 
Breast  Cancer  Surgery 

Karen  Schachter 

Duncan  Neuhauser 
Cardiac  Radionuclide  Imaging 

William  B.  Stason 

Eric  Fortess 
Cervical  Cancer  Screening 

Bryan  R.  Luce 
Cimetidine  and  Peptic  Ulcer  Disease 

Harvey  V.  Fineberg 

Laurie  A.  Pearlman 
Colon  Cancer  Screening 

David  M.  Eddy 
CT  Scanning 

Judith  L.  Wagner 
Elective  Hysterectomy 

Carol  Korenbrot 

Ann  B.  Flood 

Michael  Higgins 

Noralou  Roos 

John  P.  Bunker 
End-Stage  Renal  Disease  Interventions 

Richard  A.  Rettig 
Gastrointestinal  Endoscopy 

Jonathan  A.  Showstack 

Steven  A.  Schroeder 
Neonatal  Intensive  Care 

Peter  Budetti 

Peggy  McManus 

Nancy  Barrand 

Lu  Ann  Heinen 
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Nurse  Practitioners 

Lauren  LeRoy 
Orthopedic  Joint  Prosthetic  Implants 

Judith  D.  Bentkover 

Philip  G.  Drew 
Periodontal  Disease  Interventions 

Richard  M.  Scheffler 

Sheldon  Rovin 
Respiratory  Therapy 

Richard  M.  Scheffler 

Morgan  Delaney 

The  18th  case  study  is  published  separately  as 
Background  Paper  #3:  The  Efficacy  and  Cost-Effec- 
tiveness of  Psychotherapy .  That  study  assesses  meth- 
odological and  substantive  issues  relating  to  the 
scope  of  psychotherapy,  the  evaluation  of  psycho- 
therapeutic efficacy,  and  the  applicability  of  CEA/ 
CBA  in  assessing  psychotherapy.  It  was  prepared  by 
Leonard  Saxe  on  the  basis  of  a  report  prepared  for 
OTA  by  Brian  Yates  and  Frederick  Newman.  The 
19th  case  study  was  prepared  by  Judith  Wagner  and 
is  published  separately  as  Background  Paper  #5:  As- 
sessment of  Four  Common  X-Ray  Procedures. 

Background  Paper  #4:  The  Management  of  Health 
Care  Technology  in  Ten  Countries  is  an  analysis  of 
the  policies,  programs,  and  methods,  including  cost- 
effectiveness  and  cost-benefit  techniques,  that  nine 
industrialized  nations  other  than  the  United  States 
use  to  manage  the  effects  of  medical  technology.  The 
experience  of  these  nine  countries  in  managing  medi- 
cal technology  is  compared  to  that  of  the  United 
States.  The  paper  on  the  United  States  and  the  com- 
parative analysis  were  prepared  by  OTA  staff,  as- 


sisted by  Louise  Russell.  The  authors  of  the  papers  on 
the  nine  foreign  countries  are: 
United  Kingdom 

Barbara  Stocking 
Canada 

Jack  Needleman 
Australia 

Sydney  Sax 
Japan 

Joel  Broida 
France 

Rebecca  Fuhrer 
Germany 

Karin  A.  Dumbaugh 
Netherlands 

L.M.J.  Groot 
Iceland 

David  Gunnarson 

Duncan  vB.  Neuhauser 
Sweden 

Erik  H.  G.  Gaensler 

Egon  Jonsson 

Duncan  vB.  Neuhauser 

A  related  report  prepared  by  OTA  and  reviewed 
by  the  Advisory  Panel  to  the  overall  assessment  is  A 
Review  of  Selected  Federal  Vaccine  and  Immuniza- 
tion Policies.  That  study,  published  in  September  of 
1979,  examined  vaccine  research,  development,  and 
production;  vaccine  efficacy,  safety,  and  cost-effec- 
tiveness; liability  issues;  and  factors  affecting  the  use 
of  vaccines.  Pneumococcal  vaccine  was  used  as  a 
case  study,  and  a  CEA/CBA  was  performed. 


Appendix  E.— Health  Program  Advisory  Committee, 
Authors  of  Case  Studies  of  Medical  Technologies 

(Background  Papers  #2,  #3,  and  #5) 


HEALTH  PROGRAM  ADVISORY  COMMITTEE 

Frederick  C.  Robbins,  Chairman 
Dean,  School  of  Medicine,  Case  Western  Reserve  University 


Stuart  H.  Altman 
Dean 

Florence  Heller  School 
Brandeis  University 

Robert  M.  Ball 
Senior  Scholar 
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